[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:10 dist-test-slave-t3q3 krb5kdc[14934](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:10 dist-test-slave-t3q3 krb5kdc[14934](info): set up 2 sockets
Aug 08 21:01:10 dist-test-slave-t3q3 krb5kdc[14934](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 21:01:11.757943 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:11 dist-test-slave-t3q3 krb5kdc[14934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:11.882705 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34785
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:32769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:34785
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:11.969873 14959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:11.970140 14959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:11.970191 14959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:11.971370 14959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:11.971446 14959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:11.971472 14959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:11.971501 14959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:11.971530 14959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:11.973394 14959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:32769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:34785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:11.973810 14959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:11.974124 14959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:11.982846 14971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:11.982896 14974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:11.982879 14969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:11.983700 14959 server_base.cc:1034] running on GCE node
I20260808 21:01:11.984045 14959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:11.984494 14959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:11.985652 14959 hybrid_clock.cc:648] HybridClock initialized: now 1786222871985647 us; error 55 us; skew 500 ppm
Aug 08 21:01:11 dist-test-slave-t3q3 krb5kdc[14934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222871, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:11.988848 14959 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:11.989509 14959 webserver.cc:460] Webserver started at http://127.14.146.254:35475/ using document root <none> and password file <none>
I20260808 21:01:11.989784 14959 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:11.989856 14959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:11.990013 14959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:11.991180 14959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "91ddf705859347bbb6dd8c3d4c15144f"
format_stamp: "Formatted at 2026-08-08 21:01:11 on dist-test-slave-t3q3"
server_key: "fc92b8d8da472341d005cbf7f48010d0"
server_key_iv: "3f7bc7ab238bbefd2a523e60f0ada95d"
server_key_version: "encryptionkey@0"
I20260808 21:01:11.991561 14959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "91ddf705859347bbb6dd8c3d4c15144f"
format_stamp: "Formatted at 2026-08-08 21:01:11 on dist-test-slave-t3q3"
server_key: "fc92b8d8da472341d005cbf7f48010d0"
server_key_iv: "3f7bc7ab238bbefd2a523e60f0ada95d"
server_key_version: "encryptionkey@0"
I20260808 21:01:11.993247 14959 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:01:11.994093 14987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:11.994346 14959 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:11.994467 14959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "91ddf705859347bbb6dd8c3d4c15144f"
format_stamp: "Formatted at 2026-08-08 21:01:11 on dist-test-slave-t3q3"
server_key: "fc92b8d8da472341d005cbf7f48010d0"
server_key_iv: "3f7bc7ab238bbefd2a523e60f0ada95d"
server_key_version: "encryptionkey@0"
I20260808 21:01:11.994545 14959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:12.007112 14959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:12.009521 14959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:12.009739 14959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:12.014773 14959 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:34785
I20260808 21:01:12.014859 15076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:34785 every 8 connection(s)
I20260808 21:01:12.015455 14959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:12.016908 15077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:12.018486 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 14959
I20260808 21:01:12.018613 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:12.019605 14923 external_mini_cluster.cc:1428] Setting key d6b892f2f06d096bfa2fe1dddeaa3afa
I20260808 21:01:12.021555 15077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f: Bootstrap starting.
I20260808 21:01:12.022887 15077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:12.023697 15077 log.cc:824] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:12.024896 15077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f: No bootstrap required, opened a new log
I20260808 21:01:12.028707 15077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ddf705859347bbb6dd8c3d4c15144f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34785 } }
I20260808 21:01:12.028937 15077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:12.028993 15077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ddf705859347bbb6dd8c3d4c15144f, State: Initialized, Role: FOLLOWER
I20260808 21:01:12.029212 15077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ddf705859347bbb6dd8c3d4c15144f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34785 } }
I20260808 21:01:12.029352 15077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:12.029378 15077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:12.029460 15077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:12.030370 15077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ddf705859347bbb6dd8c3d4c15144f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34785 } }
I20260808 21:01:12.030633 15077 leader_election.cc:302] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91ddf705859347bbb6dd8c3d4c15144f; no voters:
I20260808 21:01:12.030905 15077 leader_election.cc:288] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:12.031020 15092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:12.031325 15092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [term 1 LEADER]: Becoming Leader. State: Replica: 91ddf705859347bbb6dd8c3d4c15144f, State: Running, Role: LEADER
I20260808 21:01:12.031471 15077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:12.031589 15092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ddf705859347bbb6dd8c3d4c15144f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34785 } }
I20260808 21:01:12.032446 15093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91ddf705859347bbb6dd8c3d4c15144f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ddf705859347bbb6dd8c3d4c15144f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34785 } } }
I20260808 21:01:12.032557 15093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:12.032457 15096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91ddf705859347bbb6dd8c3d4c15144f. Latest consensus state: current_term: 1 leader_uuid: "91ddf705859347bbb6dd8c3d4c15144f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ddf705859347bbb6dd8c3d4c15144f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34785 } } }
I20260808 21:01:12.032608 15096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:12.032900 15102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:12.034370 15102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:12.038022 15102 catalog_manager.cc:1347] Generated new cluster ID: 2a310d21cfbd4fd5a4dec3d52f392d1c
I20260808 21:01:12.038089 15102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:12.041523 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.021253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39508 (local address 127.14.146.254:34785)
0808 21:01:12.021624 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:12.021635 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:12.021846 (+ 211us) server_negotiation.cc:407] Connection header received
0808 21:01:12.024563 (+ 2717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:12.024572 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:12.024698 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:12.024924 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:12.026622 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.028544 (+ 1922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.029988 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.030811 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.030942 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.036575 (+ 5633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:12.036581 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:12.036581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:12.036595 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:12.039032 (+ 2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.039685 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.039688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.039689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.039804 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.040164 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.040165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.040166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.040434 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:12.040713 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:12.040963 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 21:01:12.041221 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":93,"threads_started":1}
I20260808 21:01:12.047717 15102 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:12.048728 15102 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:12.052459 15102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91ddf705859347bbb6dd8c3d4c15144f: Generated new TSK 0
I20260808 21:01:12.052661 15102 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:12.094573 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34785
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:32769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:12.238556 15131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:12.238766 15131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:12.238792 15131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:12.240026 15131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:12.240130 15131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:12.240164 15131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:12.241814 15131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:32769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34785
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:12.242197 15131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:12.242468 15131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:12.251119 15138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:12.251207 15144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:12.251221 15139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:12.251425 15131 server_base.cc:1034] running on GCE node
I20260808 21:01:12.251665 15131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:12.251925 15131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:12.253095 15131 hybrid_clock.cc:648] HybridClock initialized: now 1786222872253065 us; error 47 us; skew 500 ppm
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:12.260150 15131 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:12.260777 15131 webserver.cc:460] Webserver started at http://127.14.146.193:35939/ using document root <none> and password file <none>
I20260808 21:01:12.261053 15131 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:12.261124 15131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:12.261293 15131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:12.262431 15131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "94e773ce35a34494b280d7f19e3258c9"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "f21c5e28ae7505b5f41ee2b29d746b83"
server_key_iv: "158db649592f6e1b2305dbc286387a12"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.262810 15131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "94e773ce35a34494b280d7f19e3258c9"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "f21c5e28ae7505b5f41ee2b29d746b83"
server_key_iv: "158db649592f6e1b2305dbc286387a12"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.264442 15131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:12.265407 15152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.265727 15131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:12.265874 15131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "94e773ce35a34494b280d7f19e3258c9"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "f21c5e28ae7505b5f41ee2b29d746b83"
server_key_iv: "158db649592f6e1b2305dbc286387a12"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.265960 15131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:12.282029 15131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:12.284816 15131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:12.285041 15131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:12.285467 15131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:12.285902 15131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:12.286000 15131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.286046 15131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:12.286077 15131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.301591 15131 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:34947
I20260808 21:01:12.301730 15328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:34947 every 8 connection(s)
I20260808 21:01:12.302074 15131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:12.302898 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15131
I20260808 21:01:12.302997 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:12.303186 14923 external_mini_cluster.cc:1428] Setting key d8367402845f2f9fde34c898b75e41a9
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:01:12.316708 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.303093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:46391 (local address 127.14.146.254:34785)
0808 21:01:12.303165 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:12.303174 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:12.303785 (+ 611us) server_negotiation.cc:407] Connection header received
0808 21:01:12.304928 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:12.304930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:12.304940 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:12.304995 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:12.306903 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.307736 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.309668 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.309881 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.309948 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.313114 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:12.313116 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:12.313116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:12.313124 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:12.314974 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.315428 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.315430 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.315430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.315522 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.315811 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.315812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.315812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.315978 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:12.316089 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:12.316505 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 21:01:12.316607 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 21:01:12.316807 15332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.303071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34785 (local address 127.14.146.193:46391)
0808 21:01:12.303594 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:12.303644 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:12.304777 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:12.305083 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:12.305087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:12.306370 (+ 1283us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:12.306773 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:12.306780 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.307865 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.307867 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:12.309552 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:12.309556 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.309981 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.309983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:12.310231 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.310931 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:12.310942 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:12.312983 (+ 2041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:12.315084 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:12.315091 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:12.315093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:12.315314 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:12.315620 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:12.315620 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:12.315621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:12.315718 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:12.316146 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:12.316154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:12.316302 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 21:01:12.316417 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 21:01:12.316560 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":254,"threads_started":1}
I20260808 21:01:12.317499 15329 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34785
I20260808 21:01:12.317596 15329 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:12.317754 15329 heartbeater.cc:511] Master 127.14.146.254:34785 requested a full tablet report, sending...
I20260808 21:01:12.318598 15019 ts_manager.cc:194] Registered new tserver with Master: 94e773ce35a34494b280d7f19e3258c9 (127.14.146.193:34947)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
I20260808 21:01:12.319489 15019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:46391
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:12.335054 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34785
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:32769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:12.433981 15335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:12.434270 15335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:12.434310 15335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:12.435869 15335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:12.435940 15335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:12.435985 15335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:12.437537 15335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:32769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34785
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:12.437801 15335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:12.438031 15335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:12.443670 15348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:12.443746 15335 server_base.cc:1034] running on GCE node
W20260808 21:01:12.443702 15353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:12.443696 15347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:12.444097 15335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:12.444367 15335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:12.445531 15335 hybrid_clock.cc:648] HybridClock initialized: now 1786222872445521 us; error 40 us; skew 500 ppm
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:12.448035 15335 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:12.448587 15335 webserver.cc:460] Webserver started at http://127.14.146.194:45723/ using document root <none> and password file <none>
I20260808 21:01:12.448828 15335 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:12.448899 15335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:12.449046 15335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:12.450137 15335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "86b4a7f4018d490ba819b8ae763ae329"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "9d9acf2533f2a904d7d96cd5e4c15c83"
server_key_iv: "49684fbbc94eac6a3f2cc328ea283be8"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.450520 15335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "86b4a7f4018d490ba819b8ae763ae329"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "9d9acf2533f2a904d7d96cd5e4c15c83"
server_key_iv: "49684fbbc94eac6a3f2cc328ea283be8"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.452198 15335 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:12.453169 15362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.453387 15335 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:12.453493 15335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "86b4a7f4018d490ba819b8ae763ae329"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "9d9acf2533f2a904d7d96cd5e4c15c83"
server_key_iv: "49684fbbc94eac6a3f2cc328ea283be8"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.453584 15335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:12.463629 15335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:12.465740 15335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:12.465911 15335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:12.466150 15335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:12.466476 15335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:12.466534 15335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.466570 15335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:12.466596 15335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.473425 15335 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:44437
I20260808 21:01:12.473467 15552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:44437 every 8 connection(s)
I20260808 21:01:12.473835 15335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:12.481273 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15335
I20260808 21:01:12.481374 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:12.481568 14923 external_mini_cluster.cc:1428] Setting key b7b0e50f19d8832efdf346ffceeb76a9
I20260808 21:01:12.484150 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.474654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:53431 (local address 127.14.146.254:34785)
0808 21:01:12.474733 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:12.474735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:12.474923 (+ 188us) server_negotiation.cc:407] Connection header received
0808 21:01:12.475549 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:12.475551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:12.475564 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:12.475620 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:12.476681 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.477198 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.478246 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.478456 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.478554 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.480908 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:12.480909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:12.480910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:12.480920 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:12.482692 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.483090 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.483092 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.483092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.483161 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.483403 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.483404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.483405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.483556 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:12.483625 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:12.483873 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 21:01:12.483971 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:01:12.484361 15555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.474631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34785 (local address 127.14.146.194:53431)
0808 21:01:12.474792 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:12.474829 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:12.475405 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:12.475707 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:12.475711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:12.476347 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:12.476553 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:12.476558 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.477306 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.477308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:12.478142 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:12.478144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.478565 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.478566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:12.478697 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.479330 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:12.479339 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:12.480801 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:12.482769 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:12.482775 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:12.482777 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:12.483014 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:12.483231 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:12.483231 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:12.483232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:12.483337 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:12.483620 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:12.483624 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:12.483744 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 21:01:12.483828 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 21:01:12.483957 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260808 21:01:12.484849 15553 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34785
I20260808 21:01:12.484966 15553 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:12.485158 15553 heartbeater.cc:511] Master 127.14.146.254:34785 requested a full tablet report, sending...
I20260808 21:01:12.485569 15019 ts_manager.cc:194] Registered new tserver with Master: 86b4a7f4018d490ba819b8ae763ae329 (127.14.146.194:44437)
I20260808 21:01:12.485956 15019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:53431
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:12.510648 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34785
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:32769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:12.597395 15559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:12.597637 15559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:12.597677 15559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:12.598865 15559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:12.598934 15559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:12.598978 15559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:12.600467 15559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:32769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34785
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:12.600745 15559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:12.600979 15559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:12.606292 15574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:12.606350 15571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:12.606293 15570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:12.606478 15559 server_base.cc:1034] running on GCE node
I20260808 21:01:12.606793 15559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:12.607051 15559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:12.608215 15559 hybrid_clock.cc:648] HybridClock initialized: now 1786222872608195 us; error 38 us; skew 500 ppm
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:12.610764 15559 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:12.611261 15559 webserver.cc:460] Webserver started at http://127.14.146.195:35447/ using document root <none> and password file <none>
I20260808 21:01:12.611521 15559 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:12.611593 15559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:12.611749 15559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:12.612893 15559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "7b14f429efeb4f97a28c717ceae7d221"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "0eb2b0ea3ac7acce90db221c14dba611"
server_key_iv: "4232c9327a5ee8f339daf53dd44afef9"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.613288 15559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "7b14f429efeb4f97a28c717ceae7d221"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "0eb2b0ea3ac7acce90db221c14dba611"
server_key_iv: "4232c9327a5ee8f339daf53dd44afef9"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.614630 15559 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:01:12.615370 15585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.615540 15559 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:12.615649 15559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "7b14f429efeb4f97a28c717ceae7d221"
format_stamp: "Formatted at 2026-08-08 21:01:12 on dist-test-slave-t3q3"
server_key: "0eb2b0ea3ac7acce90db221c14dba611"
server_key_iv: "4232c9327a5ee8f339daf53dd44afef9"
server_key_version: "encryptionkey@0"
I20260808 21:01:12.615724 15559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:12.623557 15559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:12.625452 15559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:12.625619 15559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:12.625854 15559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:12.626171 15559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:12.626227 15559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.626269 15559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:12.626296 15559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:12.632704 15559 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:41185
I20260808 21:01:12.632745 15767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:41185 every 8 connection(s)
I20260808 21:01:12.633142 15559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:12.637013 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15559
I20260808 21:01:12.637094 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:12.637243 14923 external_mini_cluster.cc:1428] Setting key 24989ac010ed86e4baf108363ef18c3b
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:12.642545 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.633990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:59857 (local address 127.14.146.254:34785)
0808 21:01:12.634036 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:12.634038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:12.634291 (+ 253us) server_negotiation.cc:407] Connection header received
0808 21:01:12.634760 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:12.634761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:12.634771 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:12.634824 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:12.635726 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.636313 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.637556 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.637835 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.637906 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.640235 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:12.640236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:12.640236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:12.640243 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:12.641429 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.641790 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.641791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.641791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.641842 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.642014 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.642014 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.642015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.642116 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:12.642166 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:12.642420 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 21:01:12.642482 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:01:12.642721 15776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.633972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34785 (local address 127.14.146.195:59857)
0808 21:01:12.634122 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:12.634202 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:12.634672 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:12.634878 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:12.634881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:12.635448 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:12.635645 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:12.635650 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.636392 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.636393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:12.637463 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:12.637466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.637919 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.637921 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:12.638067 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.638637 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:12.638645 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:12.640155 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:12.641499 (+ 1344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:12.641504 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:12.641506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:12.641726 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:12.641884 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:12.641884 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:12.641885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:12.641966 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:12.642194 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:12.642199 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:12.642310 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 21:01:12.642391 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:01:12.642509 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260808 21:01:12.643266 15768 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34785
I20260808 21:01:12.643369 15768 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:12.643543 15768 heartbeater.cc:511] Master 127.14.146.254:34785 requested a full tablet report, sending...
I20260808 21:01:12.643939 15019 ts_manager.cc:194] Registered new tserver with Master: 7b14f429efeb4f97a28c717ceae7d221 (127.14.146.195:41185)
I20260808 21:01:12.644368 15019 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:59857
I20260808 21:01:12.649375 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:12.674978 15784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.666829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40100 (local address 127.14.146.193:34947)
0808 21:01:12.667056 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:12.667062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:12.667074 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:01:12.667110 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:12.667112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:12.667128 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:12.667207 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:12.667777 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.668734 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.669494 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.669857 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.669923 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.672294 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:12.672301 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:12.672302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:12.672309 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:12.673715 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.674106 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.674115 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.674115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.674175 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.674389 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.674390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.674390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.674535 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:12.674691 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:12.674762 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 21:01:12.674846 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":118,"threads_started":1}
W20260808 21:01:12.675544 15193 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40100
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[14934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:12.699208 15784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:12.692194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40106 (local address 127.14.146.193:34947)
0808 21:01:12.692272 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:12.692274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:12.692322 (+ 48us) server_negotiation.cc:407] Connection header received
0808 21:01:12.692386 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:12.692387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:12.692397 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:12.692449 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:12.693003 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.693484 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.694209 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:12.694402 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:12.694464 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:12.696731 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:12.696733 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:12.696733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:12.696740 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:12.698063 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.698407 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.698408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.698409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.698470 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:12.698684 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:12.698685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:12.698686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:12.698792 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:12.698920 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:12.699017 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 21:01:12.699103 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:01:12.699787 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15131
I20260808 21:01:12.710366 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15335
I20260808 21:01:12.719460 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15559
I20260808 21:01:12.731881 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 14959
2026-08-08T21:01:12Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2270 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[15794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[15794](info): set up 2 sockets
Aug 08 21:01:12 dist-test-slave-t3q3 krb5kdc[15794](info): commencing operation
krb5kdc: starting...
W20260808 21:01:13.988390 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:14.116288 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45123
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45123
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:14.199869 15812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:14.200174 15812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:14.200227 15812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:14.201449 15812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:14.201525 15812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:14.201550 15812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:14.201583 15812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:14.201608 15812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:14.203151 15812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:14.203447 15812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:14.203685 15812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:14.208808 15825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:14.208828 15834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:14.209021 15826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:14.208936 15812 server_base.cc:1034] running on GCE node
I20260808 21:01:14.209440 15812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:14.209750 15812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:14.210923 15812 hybrid_clock.cc:648] HybridClock initialized: now 1786222874210906 us; error 50 us; skew 500 ppm
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:14.213716 15812 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:14.214201 15812 webserver.cc:460] Webserver started at http://127.14.146.254:42971/ using document root <none> and password file <none>
I20260808 21:01:14.214396 15812 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:14.214437 15812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:14.214530 15812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:14.215587 15812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "63d2a0a8b9d24333b96ee0252d20b71e"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "18f75d3d385cd45ae781d27c59cfb7d9"
server_key_iv: "17aa920b30fa79a340f854c2857b3b6c"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.215925 15812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "63d2a0a8b9d24333b96ee0252d20b71e"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "18f75d3d385cd45ae781d27c59cfb7d9"
server_key_iv: "17aa920b30fa79a340f854c2857b3b6c"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.217347 15812 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:14.218123 15842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.218321 15812 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:14.218400 15812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "63d2a0a8b9d24333b96ee0252d20b71e"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "18f75d3d385cd45ae781d27c59cfb7d9"
server_key_iv: "17aa920b30fa79a340f854c2857b3b6c"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.218459 15812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:14.232759 15812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:14.235296 15812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:14.235420 15812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:14.239817 15812 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:45123
I20260808 21:01:14.239859 15942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:45123 every 8 connection(s)
I20260808 21:01:14.240327 15812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:14.241355 15943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:14.241838 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15812
I20260808 21:01:14.241935 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:14.242097 14923 external_mini_cluster.cc:1428] Setting key 32dd77171276fe70cdabf85673e59df3
I20260808 21:01:14.244681 15943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e: Bootstrap starting.
I20260808 21:01:14.245327 15943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:14.245673 15943 log.cc:824] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:14.246464 15943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e: No bootstrap required, opened a new log
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:14.249243 15943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d2a0a8b9d24333b96ee0252d20b71e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45123 } }
I20260808 21:01:14.249441 15943 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:14.249470 15943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63d2a0a8b9d24333b96ee0252d20b71e, State: Initialized, Role: FOLLOWER
I20260808 21:01:14.249630 15943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d2a0a8b9d24333b96ee0252d20b71e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45123 } }
I20260808 21:01:14.249696 15943 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:14.249725 15943 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:14.249796 15943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:14.250398 15943 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d2a0a8b9d24333b96ee0252d20b71e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45123 } }
I20260808 21:01:14.250514 15943 leader_election.cc:302] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63d2a0a8b9d24333b96ee0252d20b71e; no voters:
I20260808 21:01:14.250727 15943 leader_election.cc:288] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:14.250764 15957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:14.250883 15957 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [term 1 LEADER]: Becoming Leader. State: Replica: 63d2a0a8b9d24333b96ee0252d20b71e, State: Running, Role: LEADER
I20260808 21:01:14.251032 15943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:14.250988 15957 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d2a0a8b9d24333b96ee0252d20b71e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45123 } }
I20260808 21:01:14.252766 15959 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63d2a0a8b9d24333b96ee0252d20b71e. Latest consensus state: current_term: 1 leader_uuid: "63d2a0a8b9d24333b96ee0252d20b71e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d2a0a8b9d24333b96ee0252d20b71e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45123 } } }
I20260808 21:01:14.252861 15958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63d2a0a8b9d24333b96ee0252d20b71e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d2a0a8b9d24333b96ee0252d20b71e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45123 } } }
I20260808 21:01:14.252915 15959 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:14.252954 15958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e [sys.catalog]: This master's current role is: LEADER
W20260808 21:01:14.253487 15975 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:01:14.253597 15975 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:01:14.253785 15976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:14.254015 15976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:14.254251 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.242680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60570 (local address 127.14.146.254:45123)
0808 21:01:14.242888 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.242896 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.242923 (+ 27us) server_negotiation.cc:407] Connection header received
0808 21:01:14.243350 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.243357 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.243403 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.243528 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:14.244353 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.245317 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.246347 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.246806 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.246890 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.249956 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:14.249960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:14.249960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:14.249972 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:14.252222 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.252683 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.252688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.252688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.252817 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.253085 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.253086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.253087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.253444 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:14.253617 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.253802 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.253952 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260808 21:01:14.255654 15976 catalog_manager.cc:1347] Generated new cluster ID: f3a688148c9540d39c51954d84c0ab6f
I20260808 21:01:14.255712 15976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:14.298866 15976 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:14.299480 15976 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:14.306859 15976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63d2a0a8b9d24333b96ee0252d20b71e: Generated new TSK 0
I20260808 21:01:14.307070 15976 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:14.339119 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45123
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:14.437152 15992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:14.437358 15992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:14.437382 15992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:14.438531 15992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:14.438575 15992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:14.438601 15992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:14.440171 15992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45123
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:14.440413 15992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:14.440649 15992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:14.445873 15997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:14.446012 15992 server_base.cc:1034] running on GCE node
W20260808 21:01:14.445886 15998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:14.445878 16002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:14.446409 15992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:14.446662 15992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:14.447808 15992 hybrid_clock.cc:648] HybridClock initialized: now 1786222874447786 us; error 39 us; skew 500 ppm
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:14.450435 15992 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:14.450887 15992 webserver.cc:460] Webserver started at http://127.14.146.193:37425/ using document root <none> and password file <none>
I20260808 21:01:14.451185 15992 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:14.451265 15992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:14.451426 15992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:14.452646 15992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "b84fe6ee0a3249968ae7e275c2a6074b"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "9a4237f6cc50220beb7cfa8605e4dc3b"
server_key_iv: "6dd8392992fcda901ba74fd41026da12"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.453058 15992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "b84fe6ee0a3249968ae7e275c2a6074b"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "9a4237f6cc50220beb7cfa8605e4dc3b"
server_key_iv: "6dd8392992fcda901ba74fd41026da12"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.454463 15992 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:01:14.455277 16016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.455457 15992 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:14.455581 15992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "b84fe6ee0a3249968ae7e275c2a6074b"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "9a4237f6cc50220beb7cfa8605e4dc3b"
server_key_iv: "6dd8392992fcda901ba74fd41026da12"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.455675 15992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:14.471791 15992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:14.473721 15992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:14.473886 15992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:14.474123 15992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:14.474439 15992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:14.474498 15992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.474567 15992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:14.474597 15992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.480690 15992 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:44469
I20260808 21:01:14.480748 16201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:44469 every 8 connection(s)
I20260808 21:01:14.481120 15992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:14.485163 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15992
I20260808 21:01:14.485252 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:14.485419 14923 external_mini_cluster.cc:1428] Setting key b0681ddce67a0821c156d0ac2fcef611
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:14.491441 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.481862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:55021 (local address 127.14.146.254:45123)
0808 21:01:14.481916 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.481919 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.482124 (+ 205us) server_negotiation.cc:407] Connection header received
0808 21:01:14.483172 (+ 1048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.483174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.483185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.483243 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:14.483822 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.484375 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.485483 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.485769 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.485844 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.488487 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:14.488489 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:14.488489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:14.488495 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:14.489973 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.490416 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.490417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.490418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.490488 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.490766 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.490767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.490767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.490888 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:14.490961 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.491253 (+ 292us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.491344 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:01:14.491636 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.481808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45123 (local address 127.14.146.193:55021)
0808 21:01:14.481973 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:14.482015 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:14.483078 (+ 1063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:14.483299 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:14.483302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:14.483560 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:14.483748 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.483752 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.484457 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.484458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.485396 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.485399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.485902 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.485903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.486052 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.486575 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:14.486585 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:14.488390 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:14.490084 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:14.490091 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:14.490094 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:14.490332 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:14.490562 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:14.490563 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:14.490563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:14.490687 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:14.490966 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:14.490973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:14.491116 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 21:01:14.491230 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 21:01:14.491392 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260808 21:01:14.492209 16202 heartbeater.cc:347] Connected to a master server at 127.14.146.254:45123
I20260808 21:01:14.492307 16202 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:14.492509 16202 heartbeater.cc:511] Master 127.14.146.254:45123 requested a full tablet report, sending...
I20260808 21:01:14.493139 15881 ts_manager.cc:194] Registered new tserver with Master: b84fe6ee0a3249968ae7e275c2a6074b (127.14.146.193:44469)
I20260808 21:01:14.494093 15881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:55021
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:14.514530 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45123
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:14.598405 16212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:14.598640 16212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:14.598666 16212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:14.599841 16212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:14.599885 16212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:14.599912 16212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:14.601428 16212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45123
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:14.601634 16212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:14.601832 16212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:14.607316 16220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:14.607410 16218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:14.607415 16217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:14.607589 16212 server_base.cc:1034] running on GCE node
I20260808 21:01:14.607970 16212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:14.608340 16212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:14.609525 16212 hybrid_clock.cc:648] HybridClock initialized: now 1786222874609503 us; error 43 us; skew 500 ppm
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:14.612378 16212 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:14.612871 16212 webserver.cc:460] Webserver started at http://127.14.146.194:36577/ using document root <none> and password file <none>
I20260808 21:01:14.613124 16212 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:14.613201 16212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:14.613356 16212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:14.614456 16212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "a33e2bd8a0d44f358f3dcf913e0d0300"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "057fe0f203b1e61128b94f962a53ab9c"
server_key_iv: "fa41ad6bfb9beaab67e578588ca8c002"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.614859 16212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "a33e2bd8a0d44f358f3dcf913e0d0300"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "057fe0f203b1e61128b94f962a53ab9c"
server_key_iv: "fa41ad6bfb9beaab67e578588ca8c002"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.616415 16212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:14.617267 16232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.617501 16212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:14.617614 16212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "a33e2bd8a0d44f358f3dcf913e0d0300"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "057fe0f203b1e61128b94f962a53ab9c"
server_key_iv: "fa41ad6bfb9beaab67e578588ca8c002"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.617700 16212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:14.627013 16212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:14.629084 16212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:14.629272 16212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:14.629527 16212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:14.629858 16212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:14.629914 16212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.629952 16212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:14.630005 16212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.635905 16212 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:37087
I20260808 21:01:14.635948 16418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:37087 every 8 connection(s)
I20260808 21:01:14.636346 16212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:14.640292 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16212
I20260808 21:01:14.640369 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:14.640538 14923 external_mini_cluster.cc:1428] Setting key 2f55cad8299bcc3b029365bc007981b6
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:14.647284 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.637081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:46511 (local address 127.14.146.254:45123)
0808 21:01:14.637127 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.637129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.637369 (+ 240us) server_negotiation.cc:407] Connection header received
0808 21:01:14.638386 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.638387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.638402 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.638449 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:14.639113 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.639624 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.640979 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.641253 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.641346 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.643815 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:14.643817 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:14.643818 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:14.643826 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:14.645634 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.646088 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.646090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.646090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.646162 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.646519 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.646521 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.646521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.646695 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:14.646776 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.647038 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.647139 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:01:14.647296 16422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.637075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45123 (local address 127.14.146.194:46511)
0808 21:01:14.637237 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:14.637274 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:14.638258 (+ 984us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:14.638542 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:14.638546 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:14.638816 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:14.639011 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.639015 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.639732 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.639733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.640881 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.640884 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.641352 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.641353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.641483 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.642039 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:14.642047 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:14.643721 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:14.645735 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:14.645742 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:14.645744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:14.645998 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:14.646289 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:14.646290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:14.646291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:14.646437 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:14.646769 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:14.646774 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:14.646898 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 21:01:14.646987 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 21:01:14.647128 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260808 21:01:14.647883 16420 heartbeater.cc:347] Connected to a master server at 127.14.146.254:45123
I20260808 21:01:14.647994 16420 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:14.648223 16420 heartbeater.cc:511] Master 127.14.146.254:45123 requested a full tablet report, sending...
I20260808 21:01:14.648680 15881 ts_manager.cc:194] Registered new tserver with Master: a33e2bd8a0d44f358f3dcf913e0d0300 (127.14.146.194:37087)
I20260808 21:01:14.649061 15881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:46511
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:14.671444 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45123
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:14.759871 16426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:14.760134 16426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:14.760185 16426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:14.761308 16426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:14.761348 16426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:14.761400 16426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:14.762877 16426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45123
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:14.763134 16426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:14.763365 16426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:14.768451 16433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:14.768510 16435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:14.768481 16432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:14.768690 16426 server_base.cc:1034] running on GCE node
I20260808 21:01:14.768908 16426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:14.769111 16426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:14.770272 16426 hybrid_clock.cc:648] HybridClock initialized: now 1786222874770257 us; error 27 us; skew 500 ppm
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:14.773200 16426 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:14.773663 16426 webserver.cc:460] Webserver started at http://127.14.146.195:35485/ using document root <none> and password file <none>
I20260808 21:01:14.773929 16426 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:14.774001 16426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:14.774161 16426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:14.775245 16426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "05127962bb38455db7ced40ff815eab6"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "52c3786b62e00c17289b677683ba15fd"
server_key_iv: "002b2995d47da44d9d4462ced33bb987"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.775620 16426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "05127962bb38455db7ced40ff815eab6"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "52c3786b62e00c17289b677683ba15fd"
server_key_iv: "002b2995d47da44d9d4462ced33bb987"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.777154 16426 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:01:14.777925 16443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.778129 16426 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:14.778244 16426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "05127962bb38455db7ced40ff815eab6"
format_stamp: "Formatted at 2026-08-08 21:01:14 on dist-test-slave-t3q3"
server_key: "52c3786b62e00c17289b677683ba15fd"
server_key_iv: "002b2995d47da44d9d4462ced33bb987"
server_key_version: "encryptionkey@0"
I20260808 21:01:14.778317 16426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:14.794139 16426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:14.796608 16426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:14.796780 16426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:14.797039 16426 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:14.797416 16426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:14.797473 16426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.797513 16426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:14.797544 16426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:14.803623 16426 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:45611
I20260808 21:01:14.803711 16623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:45611 every 8 connection(s)
I20260808 21:01:14.804051 16426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:14.807582 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16426
I20260808 21:01:14.807672 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:14.807837 14923 external_mini_cluster.cc:1428] Setting key 78e9524148ca263d02b14d5ca9903fd7
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:14.813704 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.804846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:56203 (local address 127.14.146.254:45123)
0808 21:01:14.804891 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.804893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.805111 (+ 218us) server_negotiation.cc:407] Connection header received
0808 21:01:14.806138 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.806139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.806149 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.806214 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:14.806842 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.807445 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.808851 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.809035 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.809091 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.811250 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:14.811251 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:14.811251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:14.811258 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:14.812481 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.812855 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.812856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.812856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.812907 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.813164 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.813165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.813165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.813284 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:14.813338 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.813567 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.813631 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:01:14.813943 16629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.804806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45123 (local address 127.14.146.195:56203)
0808 21:01:14.804981 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:14.805024 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:14.806046 (+ 1022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:14.806271 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:14.806275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:14.806539 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:14.806758 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.806762 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.807550 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.807551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.808790 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.808793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.809112 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.809113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.809217 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.809777 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:14.809786 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:14.811165 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:14.812554 (+ 1389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:14.812560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:14.812561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:14.812786 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:14.812966 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:14.812966 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:14.812966 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:14.813081 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:14.813343 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:14.813347 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:14.813458 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 21:01:14.813541 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 21:01:14.813674 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260808 21:01:14.814430 16624 heartbeater.cc:347] Connected to a master server at 127.14.146.254:45123
I20260808 21:01:14.814534 16624 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:14.814714 16624 heartbeater.cc:511] Master 127.14.146.254:45123 requested a full tablet report, sending...
I20260808 21:01:14.815171 15881 ts_manager.cc:194] Registered new tserver with Master: 05127962bb38455db7ced40ff815eab6 (127.14.146.195:45611)
I20260808 21:01:14.815552 15881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:56203
I20260808 21:01:14.819542 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:01:14.827251 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.821499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60580 (local address 127.14.146.254:45123)
0808 21:01:14.821584 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.821587 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.821656 (+ 69us) server_negotiation.cc:407] Connection header received
0808 21:01:14.821761 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.821762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.821770 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.821828 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:14.822395 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.822857 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.823587 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.823784 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.823864 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.824992 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:14.824993 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:14.824993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:14.825000 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:14.826082 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.826441 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.826442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.826443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.826505 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.826713 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.826714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.826714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.826859 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:14.826970 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.827074 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.827151 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 21:01:14.829758 15881 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:14.831430 15881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:14.838933 16646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.834705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47406 (local address 127.14.146.195:45611)
0808 21:01:14.834876 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.834881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.835122 (+ 241us) server_negotiation.cc:407] Connection header received
0808 21:01:14.835198 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.835200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.835213 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.835304 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:14.835507 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.836630 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.837910 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.838481 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.838542 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.838580 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.838801 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.838849 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":104,"threads_started":1}
I20260808 21:01:14.839000 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.835051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37194 (local address 127.14.146.193:44469)
0808 21:01:14.835743 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.835747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.835759 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:01:14.835798 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.835800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.835815 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.835896 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:14.836021 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.836981 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.838124 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.838644 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.838722 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.838781 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.838872 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.838914 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":119,"threads_started":1}
I20260808 21:01:14.839046 16644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.834561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44469 (local address 127.0.0.1:37194)
0808 21:01:14.835526 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:14.835536 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:14.835590 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:14.835909 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:14.835910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:14.835912 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:14.835958 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.835959 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.837080 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.837081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.838023 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.838026 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.838734 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.838735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.838796 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.838800 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:14.838860 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 21:01:14.838924 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":938,"thread_start_us":127,"threads_started":1}
I20260808 21:01:14.839542 16645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.834539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:45611 (local address 127.0.0.1:47406)
0808 21:01:14.835046 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:14.835056 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:14.835120 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:14.835338 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:14.835342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:14.835344 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:14.835411 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.835413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.836743 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.836743 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.837820 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.837823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.838579 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.838580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.838664 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.838680 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 21:01:14.839405 (+ 725us) client_negotiation.cc:240] Negotiation successful
0808 21:01:14.839472 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":7,"spinlock_wait_cycles":768,"thread_start_us":108,"threads_started":1}
I20260808 21:01:14.839757 16648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.834764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56196 (local address 127.14.146.194:37087)
0808 21:01:14.835264 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.835274 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.835282 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:14.835313 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.835314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.835325 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.835414 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:14.835563 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.836466 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.838613 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.839342 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.839432 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.839480 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.839573 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.839610 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":83,"threads_started":1}
I20260808 21:01:14.839671 16643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.834538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:37087 (local address 127.0.0.1:56196)
0808 21:01:14.834703 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:14.834743 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:14.834810 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:14.835415 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:14.835416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:14.835418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:14.835468 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.835470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.836559 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.836560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.837820 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.837823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.839431 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.839432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.839496 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.839500 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:14.839558 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 21:01:14.839600 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":2,"thread_start_us":64,"threads_started":1}
I20260808 21:01:14.839921 16093 tablet_service.cc:1467] Processing CreateTablet for tablet 52dade3984884efca35c33cd710be6d1 (DEFAULT_TABLE table=test-table [id=5398633f4142420194080838d6d2ed41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:14.840376 16093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52dade3984884efca35c33cd710be6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:14.840477 16522 tablet_service.cc:1467] Processing CreateTablet for tablet 52dade3984884efca35c33cd710be6d1 (DEFAULT_TABLE table=test-table [id=5398633f4142420194080838d6d2ed41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:14.840804 16522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52dade3984884efca35c33cd710be6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:14.843133 16652 tablet_bootstrap.cc:492] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b: Bootstrap starting.
I20260808 21:01:14.843508 16305 tablet_service.cc:1467] Processing CreateTablet for tablet 52dade3984884efca35c33cd710be6d1 (DEFAULT_TABLE table=test-table [id=5398633f4142420194080838d6d2ed41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:14.843604 16654 tablet_bootstrap.cc:492] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6: Bootstrap starting.
I20260808 21:01:14.843842 16305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52dade3984884efca35c33cd710be6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:14.843946 16652 tablet_bootstrap.cc:654] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:14.844255 16654 tablet_bootstrap.cc:654] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:14.844702 16652 log.cc:824] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:14.844854 16654 log.cc:824] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:14.845578 16654 tablet_bootstrap.cc:492] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6: No bootstrap required, opened a new log
I20260808 21:01:14.845580 16652 tablet_bootstrap.cc:492] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b: No bootstrap required, opened a new log
I20260808 21:01:14.845665 16652 ts_tablet_manager.cc:1397] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 21:01:14.845672 16654 ts_tablet_manager.cc:1397] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:14.847230 16657 tablet_bootstrap.cc:492] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300: Bootstrap starting.
I20260808 21:01:14.847282 16654 raft_consensus.cc:348] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.847468 16654 raft_consensus.cc:374] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:14.847507 16654 raft_consensus.cc:729] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05127962bb38455db7ced40ff815eab6, State: Initialized, Role: FOLLOWER
I20260808 21:01:14.847682 16654 consensus_queue.cc:260] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.847725 16652 raft_consensus.cc:348] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.847910 16652 raft_consensus.cc:374] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:14.847955 16657 tablet_bootstrap.cc:654] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:14.847958 16652 raft_consensus.cc:729] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b84fe6ee0a3249968ae7e275c2a6074b, State: Initialized, Role: FOLLOWER
I20260808 21:01:14.847972 16654 ts_tablet_manager.cc:1428] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 21:01:14.848100 16652 consensus_queue.cc:260] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.848177 16624 heartbeater.cc:503] Master 127.14.146.254:45123 was elected leader, sending a full tablet report...
I20260808 21:01:14.848409 16652 ts_tablet_manager.cc:1428] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 21:01:14.848430 16202 heartbeater.cc:503] Master 127.14.146.254:45123 was elected leader, sending a full tablet report...
I20260808 21:01:14.848671 16657 log.cc:824] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:14.849448 16657 tablet_bootstrap.cc:492] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300: No bootstrap required, opened a new log
I20260808 21:01:14.849521 16657 ts_tablet_manager.cc:1397] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:01:14.850988 16657 raft_consensus.cc:348] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.851135 16657 raft_consensus.cc:374] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:14.851157 16657 raft_consensus.cc:729] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a33e2bd8a0d44f358f3dcf913e0d0300, State: Initialized, Role: FOLLOWER
I20260808 21:01:14.851231 16657 consensus_queue.cc:260] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.851444 16657 ts_tablet_manager.cc:1428] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:01:14.851473 16420 heartbeater.cc:503] Master 127.14.146.254:45123 was elected leader, sending a full tablet report...
I20260808 21:01:14.857498 16662 raft_consensus.cc:482] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:14.857576 16662 raft_consensus.cc:504] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.858105 16662 leader_election.cc:288] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05127962bb38455db7ced40ff815eab6 (127.14.146.195:45611), b84fe6ee0a3249968ae7e275c2a6074b (127.14.146.193:44469)
I20260808 21:01:14.861071 16422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.858265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44469 (local address 127.14.146.194:55201)
0808 21:01:14.858324 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:14.858335 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:14.858376 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:14.858510 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:14.858511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:14.858513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:14.858580 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.858582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.859399 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.859401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.860233 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.860235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.860800 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.860801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.860883 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.860891 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 21:01:14.860966 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 21:01:14.861006 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 21:01:14.861076 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.858323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:55201 (local address 127.14.146.193:44469)
0808 21:01:14.858369 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.858371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.858380 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:14.858438 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.858439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.858448 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.858501 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:14.858667 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.859318 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.860318 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.860703 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.860800 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.860809 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.860975 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.861009 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:14.861358 16646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.858323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:36219 (local address 127.14.146.195:45611)
0808 21:01:14.858383 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.858385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.858621 (+ 236us) server_negotiation.cc:407] Connection header received
0808 21:01:14.858703 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.858704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.858712 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.858783 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:14.858921 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.859594 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.860584 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.860955 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.861048 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.861056 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.861251 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.861296 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 21:01:14.861483 16125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52dade3984884efca35c33cd710be6d1" candidate_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" is_pre_election: true
I20260808 21:01:14.861596 16663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.858265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:45611 (local address 127.14.146.194:36219)
0808 21:01:14.858540 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:14.858550 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:14.858636 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:14.858786 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:14.858787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:14.858788 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:14.858862 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.858864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.859681 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.859682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.860488 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:14.860490 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.861053 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.861054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:14.861145 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.861150 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:14.861463 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 21:01:14.861512 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":133,"thread_start_us":93,"threads_started":1}
I20260808 21:01:14.861657 16125 raft_consensus.cc:2454] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a33e2bd8a0d44f358f3dcf913e0d0300 in term 0.
I20260808 21:01:14.861964 16238 leader_election.cc:302] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a33e2bd8a0d44f358f3dcf913e0d0300, b84fe6ee0a3249968ae7e275c2a6074b; no voters:
I20260808 21:01:14.862090 16662 raft_consensus.cc:2781] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:14.862046 16548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52dade3984884efca35c33cd710be6d1" candidate_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05127962bb38455db7ced40ff815eab6" is_pre_election: true
I20260808 21:01:14.862144 16662 raft_consensus.cc:482] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:14.862179 16662 raft_consensus.cc:3037] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:14.862191 16548 raft_consensus.cc:2454] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a33e2bd8a0d44f358f3dcf913e0d0300 in term 0.
I20260808 21:01:14.862839 16662 raft_consensus.cc:504] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.862977 16662 leader_election.cc:288] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [CANDIDATE]: Term 1 election: Requested vote from peers 05127962bb38455db7ced40ff815eab6 (127.14.146.195:45611), b84fe6ee0a3249968ae7e275c2a6074b (127.14.146.193:44469)
I20260808 21:01:14.863125 16548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52dade3984884efca35c33cd710be6d1" candidate_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05127962bb38455db7ced40ff815eab6"
I20260808 21:01:14.863130 16125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52dade3984884efca35c33cd710be6d1" candidate_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b84fe6ee0a3249968ae7e275c2a6074b"
I20260808 21:01:14.863215 16125 raft_consensus.cc:3037] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:14.863219 16548 raft_consensus.cc:3037] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:14.863826 16125 raft_consensus.cc:2454] T 52dade3984884efca35c33cd710be6d1 P b84fe6ee0a3249968ae7e275c2a6074b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a33e2bd8a0d44f358f3dcf913e0d0300 in term 1.
I20260808 21:01:14.863932 16548 raft_consensus.cc:2454] T 52dade3984884efca35c33cd710be6d1 P 05127962bb38455db7ced40ff815eab6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a33e2bd8a0d44f358f3dcf913e0d0300 in term 1.
I20260808 21:01:14.863989 16238 leader_election.cc:302] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a33e2bd8a0d44f358f3dcf913e0d0300, b84fe6ee0a3249968ae7e275c2a6074b; no voters:
I20260808 21:01:14.864192 16662 raft_consensus.cc:2781] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:14.864351 16662 raft_consensus.cc:686] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [term 1 LEADER]: Becoming Leader. State: Replica: a33e2bd8a0d44f358f3dcf913e0d0300, State: Running, Role: LEADER
I20260808 21:01:14.864440 16662 consensus_queue.cc:237] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } }
I20260808 21:01:14.865377 15881 catalog_manager.cc:5495] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300 reported cstate change: term changed from 0 to 1, leader changed from <none> to a33e2bd8a0d44f358f3dcf913e0d0300 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a33e2bd8a0d44f358f3dcf913e0d0300" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05127962bb38455db7ced40ff815eab6" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b84fe6ee0a3249968ae7e275c2a6074b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44469 } health_report { overall_health: UNKNOWN } } }
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:14.881868 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.874254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37206 (local address 127.14.146.193:44469)
0808 21:01:14.874335 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.874337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.874375 (+ 38us) server_negotiation.cc:407] Connection header received
0808 21:01:14.874441 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.874442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.874450 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.874493 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:14.875001 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.875455 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.876214 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.876395 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.876449 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.878724 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:14.878733 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:14.878734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:14.878740 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:14.880574 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.880949 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.880954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.880954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.881044 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.881272 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.881272 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.881273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.881423 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:14.881571 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.881653 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.881740 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260808 21:01:14.886907 16421 tablet.cc:2369] T 52dade3984884efca35c33cd710be6d1 P a33e2bd8a0d44f358f3dcf913e0d0300: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:14.906447 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.899489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37222 (local address 127.14.146.193:44469)
0808 21:01:14.899554 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.899555 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.899602 (+ 47us) server_negotiation.cc:407] Connection header received
0808 21:01:14.899654 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.899656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.899664 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.899722 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:14.900350 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.900849 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.901613 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.901801 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.901854 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.904212 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:14.904213 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:14.904213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:14.904220 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:14.905427 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.905749 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.905750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.905750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.905809 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.905977 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.905978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.905978 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.906096 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:14.906175 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.906316 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.906379 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 21:01:14 dist-test-slave-t3q3 krb5kdc[15794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:14.930677 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:14.923667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.14.146.193:44469)
0808 21:01:14.923736 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:14.923739 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:14.923843 (+ 104us) server_negotiation.cc:407] Connection header received
0808 21:01:14.923875 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:14.923876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:14.923887 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:14.923944 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:14.924602 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.925099 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.925813 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:14.925996 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:14.926073 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:14.928354 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:14.928356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:14.928356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:14.928363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:14.929562 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.929959 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.929960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.929961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.930037 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:14.930239 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:14.930239 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:14.930240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:14.930336 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:14.930411 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:14.930510 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 21:01:14.930574 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 21:01:14.931519 16060 tablet_service.cc:2908] Rejecting scan request for tablet 52dade3984884efca35c33cd710be6d1: Uninitialized: clean time has not yet been initialized
I20260808 21:01:14.932572 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15992
I20260808 21:01:14.943907 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16212
I20260808 21:01:14.956020 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16426
I20260808 21:01:14.967962 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15812
2026-08-08T21:01:14Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2235 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:15 dist-test-slave-t3q3 krb5kdc[16685](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:15 dist-test-slave-t3q3 krb5kdc[16685](info): set up 2 sockets
Aug 08 21:01:15 dist-test-slave-t3q3 krb5kdc[16685](info): commencing operation
krb5kdc: starting...
W20260808 21:01:16.233585 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:16 dist-test-slave-t3q3 krb5kdc[16685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:16.363101 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:37967
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:37967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:16.446957 16703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:16.447152 16703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:16.447175 16703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:16.448386 16703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:16.448429 16703 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 21:01:16.448443 16703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:16.448457 16703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:16.448505 16703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:16.448522 16703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:16.450054 16703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:37967
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:37967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:16.450312 16703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:16.450553 16703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:16.455647 16714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:16.455647 16713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:16.455683 16717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:16.455729 16703 server_base.cc:1034] running on GCE node
I20260808 21:01:16.456202 16703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:16.456485 16703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:16.457657 16703 hybrid_clock.cc:648] HybridClock initialized: now 1786222876457647 us; error 37 us; skew 500 ppm
Aug 08 21:01:16 dist-test-slave-t3q3 krb5kdc[16685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:16.460038 16703 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:16.460558 16703 webserver.cc:460] Webserver started at http://127.14.146.254:46189/ using document root <none> and password file <none>
I20260808 21:01:16.460799 16703 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:16.460916 16703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:16.461086 16703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:16.462459 16703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "ca3a714b91c144459d7c3d95da42f332"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "48f10ba09c2a2a0b323827a981cc0385"
server_key_iv: "b20c76e3926c8fb8b853f1642423922b"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.462846 16703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "ca3a714b91c144459d7c3d95da42f332"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "48f10ba09c2a2a0b323827a981cc0385"
server_key_iv: "b20c76e3926c8fb8b853f1642423922b"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.464213 16703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 21:01:16.464969 16727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:16.465199 16703 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:16.465308 16703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "ca3a714b91c144459d7c3d95da42f332"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "48f10ba09c2a2a0b323827a981cc0385"
server_key_iv: "b20c76e3926c8fb8b853f1642423922b"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.465396 16703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:16.477065 16703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:16.478858 16703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:16.479018 16703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:16.484218 16703 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:37967
I20260808 21:01:16.484319 16817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:37967 every 8 connection(s)
I20260808 21:01:16.484637 16703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:16.485291 16818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:16.487422 16818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332: Bootstrap starting.
I20260808 21:01:16.487947 16818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:16.488273 16818 log.cc:824] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:16.488550 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16703
I20260808 21:01:16.488647 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:16.488829 14923 external_mini_cluster.cc:1428] Setting key 62db218ab600002118120d83abe629af
I20260808 21:01:16.489130 16818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332: No bootstrap required, opened a new log
I20260808 21:01:16.492107 16818 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3a714b91c144459d7c3d95da42f332" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37967 } }
I20260808 21:01:16.492275 16818 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:16.492307 16818 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca3a714b91c144459d7c3d95da42f332, State: Initialized, Role: FOLLOWER
I20260808 21:01:16.492449 16818 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3a714b91c144459d7c3d95da42f332" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37967 } }
I20260808 21:01:16.492522 16818 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:16.492549 16818 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:16.492592 16818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:16.493203 16818 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3a714b91c144459d7c3d95da42f332" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37967 } }
I20260808 21:01:16.493296 16818 leader_election.cc:302] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca3a714b91c144459d7c3d95da42f332; no voters:
I20260808 21:01:16.493441 16818 leader_election.cc:288] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:16.493526 16825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:16.493695 16818 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:16.493709 16825 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [term 1 LEADER]: Becoming Leader. State: Replica: ca3a714b91c144459d7c3d95da42f332, State: Running, Role: LEADER
I20260808 21:01:16.493860 16825 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3a714b91c144459d7c3d95da42f332" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37967 } }
I20260808 21:01:16.494256 16825 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca3a714b91c144459d7c3d95da42f332. Latest consensus state: current_term: 1 leader_uuid: "ca3a714b91c144459d7c3d95da42f332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3a714b91c144459d7c3d95da42f332" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37967 } } }
I20260808 21:01:16.494267 16826 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca3a714b91c144459d7c3d95da42f332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3a714b91c144459d7c3d95da42f332" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37967 } } }
I20260808 21:01:16.494447 16825 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:16.494458 16826 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:16.494760 16847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:16.495307 16847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 21:01:16 dist-test-slave-t3q3 krb5kdc[16685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:16.497089 16847 catalog_manager.cc:1347] Generated new cluster ID: 3befe80a15d44f56a5f4b6c77279b691
I20260808 21:01:16.497143 16847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:16.501293 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.489347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56414 (local address 127.14.146.254:37967)
0808 21:01:16.489555 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:16.489565 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:16.489601 (+ 36us) server_negotiation.cc:407] Connection header received
0808 21:01:16.490440 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:16.490450 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:16.490512 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:16.490669 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:16.491255 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.492708 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.493713 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.494291 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.494384 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.497410 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:16.497415 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:16.497415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:16.497426 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:16.499423 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.499821 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.499824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.499825 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.499937 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.500160 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.500160 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.500161 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.500461 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:16.500637 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:16.500717 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 21:01:16.500852 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
I20260808 21:01:16.515627 16847 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:16.516239 16847 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:16.520833 16847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332: Generated new TSK 0
I20260808 21:01:16.521023 16847 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:16.551275 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37967
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:16.636612 16864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:16.636819 16864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:16.636843 16864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:16.638020 16864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:16.638073 16864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:16.638094 16864 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:16.638113 16864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:16.639575 16864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:37967
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:16.639835 16864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:16.640106 16864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:16.645315 16880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:16.645315 16872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:16.645738 16864 server_base.cc:1034] running on GCE node
W20260808 21:01:16.645452 16875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:16.646059 16864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:16.646351 16864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:16.647523 16864 hybrid_clock.cc:648] HybridClock initialized: now 1786222876647494 us; error 40 us; skew 500 ppm
Aug 08 21:01:16 dist-test-slave-t3q3 krb5kdc[16685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:16.650385 16864 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:16.650877 16864 webserver.cc:460] Webserver started at http://127.14.146.193:34001/ using document root <none> and password file <none>
I20260808 21:01:16.651119 16864 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:16.651194 16864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:16.651353 16864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:16.652535 16864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "808b40f24c954481b3f1da0b9bc02cf3"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "360a8c90ff56de4416b3d12bb6c0eb25"
server_key_iv: "8dc9a2110f07057c6ef80ef8a884255b"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.652930 16864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "808b40f24c954481b3f1da0b9bc02cf3"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "360a8c90ff56de4416b3d12bb6c0eb25"
server_key_iv: "8dc9a2110f07057c6ef80ef8a884255b"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.654362 16864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 21:01:16.655136 16889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:16.655356 16864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:16.655468 16864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "808b40f24c954481b3f1da0b9bc02cf3"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "360a8c90ff56de4416b3d12bb6c0eb25"
server_key_iv: "8dc9a2110f07057c6ef80ef8a884255b"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.655543 16864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:16.669099 16864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:16.671602 16864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:16.671769 16864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:16.672425 16864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:16.672492 16864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:16.672549 16864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:16.672577 16864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:16.679607 16864 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:42611
I20260808 21:01:16.679699 17085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:42611 every 8 connection(s)
I20260808 21:01:16.680014 16864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
Aug 08 21:01:16 dist-test-slave-t3q3 krb5kdc[16685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:16.683676 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.673136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:59711 (local address 127.14.146.254:37967)
0808 21:01:16.673183 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:16.673186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:16.673449 (+ 263us) server_negotiation.cc:407] Connection header received
0808 21:01:16.674119 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:16.674121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:16.674138 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:16.674214 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:16.675149 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.676027 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.677678 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.678038 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.678128 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.681046 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:16.681048 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:16.681048 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:16.681055 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:16.682355 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.682763 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.682764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.682764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.682819 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.683126 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.683127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.683127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.683237 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:16.683289 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:16.683531 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 21:01:16.683608 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:16.683905 16901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.673145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37967 (local address 127.14.146.193:59711)
0808 21:01:16.673321 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:16.673358 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:16.673936 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:16.674325 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:16.674331 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:16.674711 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:16.675019 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:16.675037 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.676163 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.676164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:16.677590 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:16.677593 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.678164 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.678166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:16.678341 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.679020 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:16.679032 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:16.680933 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:16.682446 (+ 1513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:16.682454 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:16.682456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:16.682691 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:16.682913 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:16.682914 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:16.682914 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:16.683061 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:16.683281 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:16.683284 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:16.683402 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 21:01:16.683482 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 21:01:16.683617 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260808 21:01:16.684461 17087 heartbeater.cc:347] Connected to a master server at 127.14.146.254:37967
I20260808 21:01:16.684573 17087 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:16.684769 17087 heartbeater.cc:511] Master 127.14.146.254:37967 requested a full tablet report, sending...
I20260808 21:01:16.685356 16751 ts_manager.cc:194] Registered new tserver with Master: 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611)
I20260808 21:01:16.686092 16751 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:59711
I20260808 21:01:16.687041 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16864
I20260808 21:01:16.687144 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:16.687314 14923 external_mini_cluster.cc:1428] Setting key 1c20a6bad57cf46e3c99fb019ceac10f
I20260808 21:01:16.692359 17094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.685629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37967 (local address 127.14.146.193:53741)
0808 21:01:16.685756 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:16.685766 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:16.685822 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:16.686408 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:16.686409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:16.686661 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:16.686728 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:16.686731 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.687715 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.687716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:16.688362 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:16.688365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.688824 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.688825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:16.688890 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.689348 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:16.689353 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:16.689719 (+ 366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:16.691257 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:16.691258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:16.691258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:16.691481 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:16.691705 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:16.691706 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:16.691706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:16.691764 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:16.692056 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:16.692096 (+ 40us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:16.692150 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 21:01:16.692205 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 21:01:16.692286 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260808 21:01:16.692480 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.685693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:53741 (local address 127.14.146.254:37967)
0808 21:01:16.686293 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:16.686294 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:16.686303 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:16.686320 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:16.686321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:16.686332 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:16.686388 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:16.686877 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.687633 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.688442 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.688742 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.688819 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.689824 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:16.689826 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:16.689826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:16.689835 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:16.691165 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.691567 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.691569 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.691569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.691635 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.691830 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.691830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.691831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.691974 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:16.692048 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:16.692260 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 21:01:16.692347 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582}
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:16.715231 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37967
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:16.801760 17097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:16.801962 17097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:16.801986 17097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:16.803066 17097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:16.803099 17097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:16.803118 17097 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:16.803136 17097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:16.804489 17097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:37967
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:16.804669 17097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:16.804844 17097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 21:01:16.809917 17097 server_base.cc:1034] running on GCE node
W20260808 21:01:16.809888 17117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:16.809900 17114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:16.809895 17115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:16.810344 17097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:16.810541 17097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:16.811704 17097 hybrid_clock.cc:648] HybridClock initialized: now 1786222876811687 us; error 29 us; skew 500 ppm
Aug 08 21:01:16 dist-test-slave-t3q3 krb5kdc[16685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:16.814646 17097 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:16.815143 17097 webserver.cc:460] Webserver started at http://127.14.146.194:38533/ using document root <none> and password file <none>
I20260808 21:01:16.815395 17097 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:16.815472 17097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:16.815631 17097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:16.817384 17097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "004e5b5d0274444781d54bcd13e685d2"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "e0f825007081fc39d64aeb0a0d4bdb94"
server_key_iv: "cbdeaa59dc72f7627c56549cf351e3d3"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.817797 17097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "004e5b5d0274444781d54bcd13e685d2"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "e0f825007081fc39d64aeb0a0d4bdb94"
server_key_iv: "cbdeaa59dc72f7627c56549cf351e3d3"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.819340 17097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:01:16.820250 17138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:16.820446 17097 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:16.820554 17097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "004e5b5d0274444781d54bcd13e685d2"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "e0f825007081fc39d64aeb0a0d4bdb94"
server_key_iv: "cbdeaa59dc72f7627c56549cf351e3d3"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.820653 17097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:16.841385 17097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:16.844049 17097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:16.844260 17097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:16.844841 17097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:16.844910 17097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:16.844956 17097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:16.844990 17097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 21:01:16 dist-test-slave-t3q3 krb5kdc[16685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:16.852888 17097 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:41841
I20260808 21:01:16.852959 17343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:41841 every 8 connection(s)
I20260808 21:01:16.853389 17097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:16.855018 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.845401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:49167 (local address 127.14.146.254:37967)
0808 21:01:16.845488 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:16.845491 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:16.845649 (+ 158us) server_negotiation.cc:407] Connection header received
0808 21:01:16.846135 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:16.846137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:16.846152 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:16.846241 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:16.847114 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.848120 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.849215 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.849620 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.849708 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.852153 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:16.852155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:16.852155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:16.852163 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:16.853884 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.854261 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.854262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.854262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.854313 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.854540 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.854541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.854541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.854642 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:16.854692 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:16.854900 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 21:01:16.854957 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 21:01:16.855243 17153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.845332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37967 (local address 127.14.146.194:49167)
0808 21:01:16.845504 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:16.845552 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:16.846030 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:16.846335 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:16.846341 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:16.846703 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:16.846992 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:16.846999 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.848235 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.848236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:16.849123 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:16.849125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.849731 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.849732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:16.849887 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.850402 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:16.850412 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:16.852006 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:16.853953 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:16.853957 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:16.853959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:16.854193 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:16.854360 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:16.854360 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:16.854361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:16.854473 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:16.854684 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:16.854687 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:16.854800 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 21:01:16.854889 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 21:01:16.855012 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
I20260808 21:01:16.855746 17346 heartbeater.cc:347] Connected to a master server at 127.14.146.254:37967
I20260808 21:01:16.855834 17346 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:16.856019 17346 heartbeater.cc:511] Master 127.14.146.254:37967 requested a full tablet report, sending...
I20260808 21:01:16.856484 16751 ts_manager.cc:194] Registered new tserver with Master: 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194:41841)
I20260808 21:01:16.856961 16751 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:49167
I20260808 21:01:16.861069 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17097
I20260808 21:01:16.861145 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:16.861327 14923 external_mini_cluster.cc:1428] Setting key cad20f2a5aabd613fc60c1202761f1be
I20260808 21:01:16.862497 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.856901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:48755 (local address 127.14.146.254:37967)
0808 21:01:16.856940 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:16.856942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:16.857048 (+ 106us) server_negotiation.cc:407] Connection header received
0808 21:01:16.857092 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:16.857093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:16.857103 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:16.857159 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:16.857529 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.858136 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.858849 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.859079 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.859133 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.859943 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:16.859944 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:16.859944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:16.859950 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:16.861275 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.861683 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.861684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.861684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.861735 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:16.861946 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:16.861946 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:16.861947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:16.862089 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:16.862169 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:16.862340 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 21:01:16.862413 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:16.862506 17354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:16.856832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37967 (local address 127.14.146.194:48755)
0808 21:01:16.856955 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:16.856965 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:16.857023 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:16.857174 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:16.857175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:16.857385 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:16.857444 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:16.857445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.858217 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.858217 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:16.858780 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:16.858782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:16.859144 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:16.859145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:16.859200 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:16.859598 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:16.859602 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:16.859869 (+ 267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:16.861368 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:16.861369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:16.861370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:16.861599 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:16.861805 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:16.861806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:16.861806 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:16.861878 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:16.862167 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:16.862168 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:16.862215 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 21:01:16.862300 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:01:16.862404 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":67,"threads_started":1}
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:16.887503 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37967
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:38607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:16.973078 17358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:16.973274 17358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:16.973299 17358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:16.974455 17358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:16.974498 17358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:16.974543 17358 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:16.974581 17358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:16.976004 17358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:38607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:37967
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:16.976290 17358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:16.976533 17358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:16.981535 17374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:16.981588 17367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:16.981544 17368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:16.981793 17358 server_base.cc:1034] running on GCE node
I20260808 21:01:16.982080 17358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:16.982300 17358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:16.983455 17358 hybrid_clock.cc:648] HybridClock initialized: now 1786222876983444 us; error 27 us; skew 500 ppm
Aug 08 21:01:16 dist-test-slave-t3q3 krb5kdc[16685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:16.986276 17358 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:16.986739 17358 webserver.cc:460] Webserver started at http://127.14.146.195:37237/ using document root <none> and password file <none>
I20260808 21:01:16.986948 17358 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:16.986989 17358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:16.987082 17358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:16.988157 17358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "0f0f031f8c3148c995afa4b80c14aa56"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "079b6ac827e8bff0207935747c4a580d"
server_key_iv: "17301c201737262fc76b4a2231dee707"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.988477 17358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "0f0f031f8c3148c995afa4b80c14aa56"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "079b6ac827e8bff0207935747c4a580d"
server_key_iv: "17301c201737262fc76b4a2231dee707"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.989769 17358 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:16.990449 17387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:16.990645 17358 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:16.990731 17358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "0f0f031f8c3148c995afa4b80c14aa56"
format_stamp: "Formatted at 2026-08-08 21:01:16 on dist-test-slave-t3q3"
server_key: "079b6ac827e8bff0207935747c4a580d"
server_key_iv: "17301c201737262fc76b4a2231dee707"
server_key_version: "encryptionkey@0"
I20260808 21:01:16.990804 17358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:17.007398 17358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:17.009939 17358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:17.010105 17358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:17.010779 17358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:17.010848 17358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:17.010881 17358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:17.010901 17358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 21:01:17 dist-test-slave-t3q3 krb5kdc[16685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:17.018290 17358 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:41047
I20260808 21:01:17.018361 17578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:41047 every 8 connection(s)
I20260808 21:01:17.018678 17358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:17.020589 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.011155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:44853 (local address 127.14.146.254:37967)
0808 21:01:17.011221 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.011223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.011402 (+ 179us) server_negotiation.cc:407] Connection header received
0808 21:01:17.011944 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.011946 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.011960 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.012020 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:17.012686 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.013277 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.014374 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.014635 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.014711 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.017490 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:17.017492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:17.017492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:17.017502 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:17.019277 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.019722 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.019722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.019723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.019777 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.020000 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.020000 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.020000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.020173 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:17.020227 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.020458 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.020525 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 21:01:17.020788 17399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.011121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37967 (local address 127.14.146.195:44853)
0808 21:01:17.011271 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.011316 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.011836 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.012127 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.012132 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.012381 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:17.012575 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.012580 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.013393 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.013394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.014255 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.014258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.014732 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.014733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.014863 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.015470 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:17.015484 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:17.017364 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:17.019352 (+ 1988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:17.019356 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:17.019358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:17.019652 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:17.019848 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:17.019848 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:17.019848 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:17.019945 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:17.020219 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:17.020223 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:17.020341 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.020430 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.020552 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260808 21:01:17.021510 17580 heartbeater.cc:347] Connected to a master server at 127.14.146.254:37967
I20260808 21:01:17.021602 17580 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:17.021788 17580 heartbeater.cc:511] Master 127.14.146.254:37967 requested a full tablet report, sending...
I20260808 21:01:17.022223 16750 ts_manager.cc:194] Registered new tserver with Master: 0f0f031f8c3148c995afa4b80c14aa56 (127.14.146.195:41047)
I20260808 21:01:17.022677 16750 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:44853
I20260808 21:01:17.023034 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17358
I20260808 21:01:17.023105 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:17.023242 14923 external_mini_cluster.cc:1428] Setting key 2db140e20dc295da0a531f5e56607227
I20260808 21:01:17.024107 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:01:17.028726 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.022613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:41773 (local address 127.14.146.254:37967)
0808 21:01:17.022657 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.022659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.022790 (+ 131us) server_negotiation.cc:407] Connection header received
0808 21:01:17.022868 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.022869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.022882 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.022932 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:17.023315 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.023923 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.024681 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.024903 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.024983 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.025871 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:17.025873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:17.025873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:17.025880 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:17.027476 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.027870 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.027871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.027871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.027923 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.028200 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.028201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.028202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.028319 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:17.028399 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.028557 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.028635 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:17.028733 17590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.022545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37967 (local address 127.14.146.195:41773)
0808 21:01:17.022713 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.022722 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.022814 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.022946 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.022947 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.023162 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:17.023224 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.023226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.024022 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.024023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.024591 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.024593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.024981 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.024982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.025049 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.025500 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:17.025504 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:17.025781 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:17.027595 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:17.027596 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:17.027596 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:17.027793 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:17.028015 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:17.028016 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:17.028016 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:17.028121 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:17.028391 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:17.028392 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:17.028439 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.028529 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.028636 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":69,"threads_started":1}
Aug 08 21:01:17 dist-test-slave-t3q3 krb5kdc[16685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222877, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 21:01:17 dist-test-slave-t3q3 krb5kdc[16685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222877, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:17.050287 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.043224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56418 (local address 127.14.146.254:37967)
0808 21:01:17.043290 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.043292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.043301 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:17.043329 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.043330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.043338 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.043390 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:17.043960 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.044538 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.045281 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.045459 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.045505 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.047778 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:17.047779 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:17.047779 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:17.047786 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:17.049289 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.049636 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.049637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.049637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.049688 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.049844 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.049845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.049845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.049942 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:17.050014 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.050133 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.050192 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:01:17.052222 16750 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:17.053894 16750 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:17.060977 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.056364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41047 (local address 127.0.0.1:42918)
0808 21:01:17.056500 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.056547 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.056620 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.057102 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.057105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.057107 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.057193 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.057195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.058396 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.058397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.059731 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.059735 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.060643 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.060645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.060732 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.060750 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.060807 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.060874 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260808 21:01:17.061180 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.056914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60190 (local address 127.14.146.193:42611)
0808 21:01:17.057066 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.057071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.057227 (+ 156us) server_negotiation.cc:407] Connection header received
0808 21:01:17.057283 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.057285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.057301 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.057376 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.057574 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.058720 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.059933 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.060685 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.060764 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.060825 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.061040 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.061085 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":96,"threads_started":1}
I20260808 21:01:17.061282 17605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.056364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:41841 (local address 127.0.0.1:44940)
0808 21:01:17.056549 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.056560 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.056620 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.057272 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.057273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.057275 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.057323 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.057324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.058649 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.058650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.059755 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.059757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.060791 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.060792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.060874 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.060879 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.060910 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.060960 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":20,"thread_start_us":74,"threads_started":1}
I20260808 21:01:17.061614 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.056490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44940 (local address 127.14.146.194:41841)
0808 21:01:17.056949 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.056953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.056963 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:17.057000 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.057002 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.057017 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.057126 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.057409 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.058561 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.059846 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.060685 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.061371 (+ 686us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.061440 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.061469 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.061511 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":106,"threads_started":1}
I20260808 21:01:17.061787 17611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.056598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42611 (local address 127.0.0.1:60190)
0808 21:01:17.057155 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.057165 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.057222 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.057442 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.057443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.057446 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.057487 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.057488 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.058811 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.058812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.059841 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.059844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.060855 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.060856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.060914 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.060917 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.060962 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.060997 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":112,"threads_started":1}
I20260808 21:01:17.062180 17614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.056702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42918 (local address 127.14.146.195:41047)
0808 21:01:17.056889 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.056895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.056906 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:17.056948 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.056950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.056969 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.057351 (+ 382us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.057425 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.058309 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.059827 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.060523 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.061967 (+ 1444us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.062031 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.062057 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.062096 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":121,"threads_started":1}
I20260808 21:01:17.062517 16968 tablet_service.cc:1467] Processing CreateTablet for tablet de0b041fd9344a8aabc2dd1fd14fc56d (DEFAULT_TABLE table=test-table [id=0dbf9d2988544ee89aff40f00ccac4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:17.062517 17226 tablet_service.cc:1467] Processing CreateTablet for tablet de0b041fd9344a8aabc2dd1fd14fc56d (DEFAULT_TABLE table=test-table [id=0dbf9d2988544ee89aff40f00ccac4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:17.062915 16968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de0b041fd9344a8aabc2dd1fd14fc56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.062915 17226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de0b041fd9344a8aabc2dd1fd14fc56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.064613 17466 tablet_service.cc:1467] Processing CreateTablet for tablet de0b041fd9344a8aabc2dd1fd14fc56d (DEFAULT_TABLE table=test-table [id=0dbf9d2988544ee89aff40f00ccac4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:17.064963 17466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de0b041fd9344a8aabc2dd1fd14fc56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.066887 17617 tablet_bootstrap.cc:492] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Bootstrap starting.
I20260808 21:01:17.067692 17618 tablet_bootstrap.cc:492] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: Bootstrap starting.
I20260808 21:01:17.067629 17617 tablet_bootstrap.cc:654] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.068207 17617 log.cc:824] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:17.068640 17618 tablet_bootstrap.cc:654] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.069049 17618 log.cc:824] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:17.069166 17617 tablet_bootstrap.cc:492] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: No bootstrap required, opened a new log
I20260808 21:01:17.069237 17617 ts_tablet_manager.cc:1397] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:01:17.069572 17622 tablet_bootstrap.cc:492] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Bootstrap starting.
I20260808 21:01:17.070082 17618 tablet_bootstrap.cc:492] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: No bootstrap required, opened a new log
I20260808 21:01:17.070137 17618 ts_tablet_manager.cc:1397] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:17.070868 17617 raft_consensus.cc:348] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.071034 17617 raft_consensus.cc:374] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.071082 17617 raft_consensus.cc:729] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004e5b5d0274444781d54bcd13e685d2, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.071240 17617 consensus_queue.cc:260] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.071538 17617 ts_tablet_manager.cc:1428] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 21:01:17.071599 17346 heartbeater.cc:503] Master 127.14.146.254:37967 was elected leader, sending a full tablet report...
I20260808 21:01:17.071669 17618 raft_consensus.cc:348] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.071828 17618 raft_consensus.cc:374] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.071880 17618 raft_consensus.cc:729] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0f031f8c3148c995afa4b80c14aa56, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.071997 17618 consensus_queue.cc:260] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.072342 17618 ts_tablet_manager.cc:1428] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:17.072381 17580 heartbeater.cc:503] Master 127.14.146.254:37967 was elected leader, sending a full tablet report...
I20260808 21:01:17.072685 17622 tablet_bootstrap.cc:654] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.073071 17622 log.cc:824] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:17.073840 17622 tablet_bootstrap.cc:492] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: No bootstrap required, opened a new log
I20260808 21:01:17.073904 17622 ts_tablet_manager.cc:1397] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 21:01:17.075330 17622 raft_consensus.cc:348] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.075541 17622 raft_consensus.cc:374] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.075589 17622 raft_consensus.cc:729] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 808b40f24c954481b3f1da0b9bc02cf3, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.075747 17622 consensus_queue.cc:260] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.076016 17622 ts_tablet_manager.cc:1428] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:17.076120 17087 heartbeater.cc:503] Master 127.14.146.254:37967 was elected leader, sending a full tablet report...
W20260808 21:01:17.104189 17347 tablet.cc:2369] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:17.144091 17625 raft_consensus.cc:482] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:17.144238 17625 raft_consensus.cc:504] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.144553 17625 leader_election.cc:288] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611), 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194:41841)
I20260808 21:01:17.147699 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.144978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:52299 (local address 127.14.146.194:41841)
0808 21:01:17.145068 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.145070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.145080 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:17.145112 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.145113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.145123 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.145182 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.145398 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.145907 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.146881 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.147308 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.147366 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.147373 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.147580 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.147622 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 21:01:17.147715 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.144906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:58365 (local address 127.14.146.193:42611)
0808 21:01:17.144957 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.144959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.145141 (+ 182us) server_negotiation.cc:407] Connection header received
0808 21:01:17.145204 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.145206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.145217 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.145294 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.145503 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.146013 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.146957 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.147325 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.147418 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.147428 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.147611 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.147649 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:01:17.147715 17399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.144791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:41841 (local address 127.14.146.195:52299)
0808 21:01:17.144862 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.144876 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.144943 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.145219 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.145220 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.145223 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.145304 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.145306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.145987 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.145988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.146784 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.146787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.147398 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.147399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.147503 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.147506 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.147581 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.147634 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":3}
I20260808 21:01:17.147719 17630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.144805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42611 (local address 127.14.146.195:58365)
0808 21:01:17.145031 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.145042 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.145114 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.145305 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.145306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.145307 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.145423 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.145425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.146106 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.146107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.146866 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.146869 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.147444 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.147445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.147502 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.147506 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.147587 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.147629 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":20,"thread_start_us":124,"threads_started":1}
I20260808 21:01:17.148109 17256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0b041fd9344a8aabc2dd1fd14fc56d" candidate_uuid: "0f0f031f8c3148c995afa4b80c14aa56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004e5b5d0274444781d54bcd13e685d2" is_pre_election: true
I20260808 21:01:17.148186 17002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0b041fd9344a8aabc2dd1fd14fc56d" candidate_uuid: "0f0f031f8c3148c995afa4b80c14aa56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "808b40f24c954481b3f1da0b9bc02cf3" is_pre_election: true
I20260808 21:01:17.148298 17256 raft_consensus.cc:2454] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0f031f8c3148c995afa4b80c14aa56 in term 0.
I20260808 21:01:17.148357 17002 raft_consensus.cc:2454] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0f031f8c3148c995afa4b80c14aa56 in term 0.
I20260808 21:01:17.148569 17392 leader_election.cc:302] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 004e5b5d0274444781d54bcd13e685d2, 0f0f031f8c3148c995afa4b80c14aa56, 808b40f24c954481b3f1da0b9bc02cf3; no voters:
I20260808 21:01:17.148715 17625 raft_consensus.cc:2781] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:17.148773 17625 raft_consensus.cc:482] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:17.148797 17625 raft_consensus.cc:3037] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.149519 17625 raft_consensus.cc:504] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.149703 17625 leader_election.cc:288] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [CANDIDATE]: Term 1 election: Requested vote from peers 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611), 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194:41841)
I20260808 21:01:17.149853 17002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0b041fd9344a8aabc2dd1fd14fc56d" candidate_uuid: "0f0f031f8c3148c995afa4b80c14aa56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "808b40f24c954481b3f1da0b9bc02cf3"
I20260808 21:01:17.149909 17256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0b041fd9344a8aabc2dd1fd14fc56d" candidate_uuid: "0f0f031f8c3148c995afa4b80c14aa56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004e5b5d0274444781d54bcd13e685d2"
I20260808 21:01:17.149946 17002 raft_consensus.cc:3037] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.150019 17256 raft_consensus.cc:3037] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.150766 17002 raft_consensus.cc:2454] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0f031f8c3148c995afa4b80c14aa56 in term 1.
I20260808 21:01:17.150768 17256 raft_consensus.cc:2454] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0f031f8c3148c995afa4b80c14aa56 in term 1.
I20260808 21:01:17.151355 17393 leader_election.cc:302] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004e5b5d0274444781d54bcd13e685d2, 0f0f031f8c3148c995afa4b80c14aa56; no voters:
I20260808 21:01:17.151469 17625 raft_consensus.cc:2781] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:17.151679 17625 raft_consensus.cc:686] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0f031f8c3148c995afa4b80c14aa56, State: Running, Role: LEADER
I20260808 21:01:17.151782 17625 consensus_queue.cc:237] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } }
I20260808 21:01:17.152689 16751 catalog_manager.cc:5495] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0f031f8c3148c995afa4b80c14aa56 (127.14.146.195). New cstate: current_term: 1 leader_uuid: "0f0f031f8c3148c995afa4b80c14aa56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } health_report { overall_health: UNKNOWN } } }
W20260808 21:01:17.180835 17089 tablet.cc:2369] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:17.181952 17614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.178812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42920 (local address 127.14.146.195:41047)
0808 21:01:17.178884 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.178886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.178896 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:17.178968 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.178970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.178993 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.179070 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:17.179235 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.179756 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.181036 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.181245 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.181320 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.181556 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:17.181665 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:17.181762 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.181815 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.181841 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 21:01:17.183766 17002 raft_consensus.cc:1261] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Refusing update from remote peer 0f0f031f8c3148c995afa4b80c14aa56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:17.183768 17256 raft_consensus.cc:1261] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Refusing update from remote peer 0f0f031f8c3148c995afa4b80c14aa56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:17.184175 17633 consensus_queue.cc:1035] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:17.184294 17625 consensus_queue.cc:1035] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:17.186585 17638 mvcc.cc:205] Tried to move back new op lower bound from 7316368904941887488 to 7316368904814428160. Current Snapshot: MvccSnapshot[applied={T|T < 7316368904941887488}]
I20260808 21:01:17.187244 17639 mvcc.cc:205] Tried to move back new op lower bound from 7316368904941887488 to 7316368904814428160. Current Snapshot: MvccSnapshot[applied={T|T < 7316368904941887488 or (T in {7316368904941887488})}]
I20260808 21:01:17.189054 17646 mvcc.cc:205] Tried to move back new op lower bound from 7316368904941887488 to 7316368904814428160. Current Snapshot: MvccSnapshot[applied={T|T < 7316368904941887488}]
I20260808 21:01:17.192039 16751 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:17.192202 16751 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:17.193176 16751 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332: Sending DeleteTablet for 3 replicas of tablet de0b041fd9344a8aabc2dd1fd14fc56d
I20260808 21:01:17.193643 17226 tablet_service.cc:1514] Processing DeleteTablet for tablet de0b041fd9344a8aabc2dd1fd14fc56d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:17 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:44940
I20260808 21:01:17.193712 17466 tablet_service.cc:1514] Processing DeleteTablet for tablet de0b041fd9344a8aabc2dd1fd14fc56d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:17 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:42918
I20260808 21:01:17.193946 17655 tablet_replica.cc:330] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: stopping tablet replica
I20260808 21:01:17.193913 16968 tablet_service.cc:1514] Processing DeleteTablet for tablet de0b041fd9344a8aabc2dd1fd14fc56d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:17 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:60190
I20260808 21:01:17.194062 17655 raft_consensus.cc:2229] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:17.194175 17655 raft_consensus.cc:2258] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:17.194222 17653 tablet_replica.cc:330] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: stopping tablet replica
I20260808 21:01:17.194334 17653 raft_consensus.cc:2229] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:17.194446 17653 raft_consensus.cc:2258] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:17.194558 16751 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56418:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:17.194756 16751 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:17.195061 17655 ts_tablet_manager.cc:1905] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:17.195061 17653 ts_tablet_manager.cc:1905] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:17.195209 17657 tablet_replica.cc:330] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: stopping tablet replica
I20260808 21:01:17.195309 17657 raft_consensus.cc:2229] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:17.195403 17657 raft_consensus.cc:2258] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:17.196671 16968 tablet_service.cc:1467] Processing CreateTablet for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 (DEFAULT_TABLE table=test-table [id=c5a820ddc3bf443eba9f2157128e3eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:17.196811 16968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.196954 17653 ts_tablet_manager.cc:1918] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:17.197038 17653 log.cc:1196] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/de0b041fd9344a8aabc2dd1fd14fc56d
I20260808 21:01:17.197327 17653 ts_tablet_manager.cc:1939] T de0b041fd9344a8aabc2dd1fd14fc56d P 004e5b5d0274444781d54bcd13e685d2: Deleting consensus metadata
I20260808 21:01:17.197736 16731 catalog_manager.cc:4841] TS 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194:41841): tablet de0b041fd9344a8aabc2dd1fd14fc56d (table test-table [id=0dbf9d2988544ee89aff40f00ccac4b2]) successfully deleted
I20260808 21:01:17.197952 17655 ts_tablet_manager.cc:1918] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:17.198053 17655 log.cc:1196] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/de0b041fd9344a8aabc2dd1fd14fc56d
I20260808 21:01:17.198372 17622 tablet_bootstrap.cc:492] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: Bootstrap starting.
I20260808 21:01:17.198446 17466 tablet_service.cc:1467] Processing CreateTablet for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 (DEFAULT_TABLE table=test-table [id=c5a820ddc3bf443eba9f2157128e3eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:17.198522 17226 tablet_service.cc:1467] Processing CreateTablet for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 (DEFAULT_TABLE table=test-table [id=c5a820ddc3bf443eba9f2157128e3eaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:17.198570 17466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.198621 17226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.198769 17622 tablet_bootstrap.cc:654] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.199362 17622 tablet_bootstrap.cc:492] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: No bootstrap required, opened a new log
I20260808 21:01:17.199404 17622 ts_tablet_manager.cc:1397] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:17.199559 17622 raft_consensus.cc:348] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.199638 17622 raft_consensus.cc:374] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.199659 17622 raft_consensus.cc:729] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 808b40f24c954481b3f1da0b9bc02cf3, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.199704 17622 consensus_queue.cc:260] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.199787 17617 tablet_bootstrap.cc:492] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: Bootstrap starting.
I20260808 21:01:17.199806 17622 ts_tablet_manager.cc:1428] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:17.199916 17618 tablet_bootstrap.cc:492] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: Bootstrap starting.
I20260808 21:01:17.200238 17617 tablet_bootstrap.cc:654] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.200348 17618 tablet_bootstrap.cc:654] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.200582 17657 ts_tablet_manager.cc:1905] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:17.198410 17655 ts_tablet_manager.cc:1939] T de0b041fd9344a8aabc2dd1fd14fc56d P 0f0f031f8c3148c995afa4b80c14aa56: Deleting consensus metadata
I20260808 21:01:17.201320 16730 catalog_manager.cc:4841] TS 0f0f031f8c3148c995afa4b80c14aa56 (127.14.146.195:41047): tablet de0b041fd9344a8aabc2dd1fd14fc56d (table test-table [id=0dbf9d2988544ee89aff40f00ccac4b2]) successfully deleted
I20260808 21:01:17.201537 17618 tablet_bootstrap.cc:492] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: No bootstrap required, opened a new log
I20260808 21:01:17.201602 17618 ts_tablet_manager.cc:1397] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 21:01:17.201752 17618 raft_consensus.cc:348] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.201829 17618 raft_consensus.cc:374] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.201851 17618 raft_consensus.cc:729] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0f031f8c3148c995afa4b80c14aa56, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.201891 17618 consensus_queue.cc:260] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.201983 17618 ts_tablet_manager.cc:1428] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:17.202663 17657 ts_tablet_manager.cc:1918] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:17.202739 17657 log.cc:1196] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/de0b041fd9344a8aabc2dd1fd14fc56d
I20260808 21:01:17.202752 17617 tablet_bootstrap.cc:492] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: No bootstrap required, opened a new log
I20260808 21:01:17.202795 17617 ts_tablet_manager.cc:1397] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 21:01:17.202944 17617 raft_consensus.cc:348] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.203017 17617 raft_consensus.cc:374] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.203027 17657 ts_tablet_manager.cc:1939] T de0b041fd9344a8aabc2dd1fd14fc56d P 808b40f24c954481b3f1da0b9bc02cf3: Deleting consensus metadata
I20260808 21:01:17.203043 17617 raft_consensus.cc:729] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004e5b5d0274444781d54bcd13e685d2, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.203099 17617 consensus_queue.cc:260] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.203207 17617 ts_tablet_manager.cc:1428] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:17.203404 16730 catalog_manager.cc:4841] TS 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611): tablet de0b041fd9344a8aabc2dd1fd14fc56d (table test-table [id=0dbf9d2988544ee89aff40f00ccac4b2]) successfully deleted
W20260808 21:01:17.269234 17581 tablet.cc:2369] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:17.365803 17633 raft_consensus.cc:482] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:17.365936 17633 raft_consensus.cc:504] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.366149 17633 leader_election.cc:288] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611), 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194:41841)
I20260808 21:01:17.366411 17256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b0d1b8f3a7648ec81f29f65a24c63c4" candidate_uuid: "0f0f031f8c3148c995afa4b80c14aa56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004e5b5d0274444781d54bcd13e685d2" is_pre_election: true
I20260808 21:01:17.366421 17002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b0d1b8f3a7648ec81f29f65a24c63c4" candidate_uuid: "0f0f031f8c3148c995afa4b80c14aa56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "808b40f24c954481b3f1da0b9bc02cf3" is_pre_election: true
I20260808 21:01:17.366523 17256 raft_consensus.cc:2454] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0f031f8c3148c995afa4b80c14aa56 in term 0.
I20260808 21:01:17.366523 17002 raft_consensus.cc:2454] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f0f031f8c3148c995afa4b80c14aa56 in term 0.
I20260808 21:01:17.366739 17393 leader_election.cc:302] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004e5b5d0274444781d54bcd13e685d2, 0f0f031f8c3148c995afa4b80c14aa56; no voters:
I20260808 21:01:17.366855 17633 raft_consensus.cc:2781] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:17.366899 17633 raft_consensus.cc:482] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:17.366917 17633 raft_consensus.cc:3037] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.367663 17633 raft_consensus.cc:504] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.367851 17633 leader_election.cc:288] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [CANDIDATE]: Term 1 election: Requested vote from peers 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611), 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194:41841)
I20260808 21:01:17.368005 17002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b0d1b8f3a7648ec81f29f65a24c63c4" candidate_uuid: "0f0f031f8c3148c995afa4b80c14aa56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "808b40f24c954481b3f1da0b9bc02cf3"
I20260808 21:01:17.368132 17002 raft_consensus.cc:3037] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.368089 17256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b0d1b8f3a7648ec81f29f65a24c63c4" candidate_uuid: "0f0f031f8c3148c995afa4b80c14aa56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004e5b5d0274444781d54bcd13e685d2"
I20260808 21:01:17.368196 17256 raft_consensus.cc:3037] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.368917 17002 raft_consensus.cc:2454] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0f031f8c3148c995afa4b80c14aa56 in term 1.
I20260808 21:01:17.368920 17256 raft_consensus.cc:2454] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f0f031f8c3148c995afa4b80c14aa56 in term 1.
I20260808 21:01:17.369092 17393 leader_election.cc:302] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004e5b5d0274444781d54bcd13e685d2, 0f0f031f8c3148c995afa4b80c14aa56; no voters:
I20260808 21:01:17.369230 17633 raft_consensus.cc:2781] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:17.369323 17633 raft_consensus.cc:686] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0f031f8c3148c995afa4b80c14aa56, State: Running, Role: LEADER
I20260808 21:01:17.369376 17633 consensus_queue.cc:237] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.369966 16751 catalog_manager.cc:5495] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f0f031f8c3148c995afa4b80c14aa56 (127.14.146.195). New cstate: current_term: 1 leader_uuid: "0f0f031f8c3148c995afa4b80c14aa56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } health_report { overall_health: HEALTHY } } }
Aug 08 21:01:17 dist-test-slave-t3q3 krb5kdc[16685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222876, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:17.420125 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.412925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56432 (local address 127.14.146.254:37967)
0808 21:01:17.413013 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.413016 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.413162 (+ 146us) server_negotiation.cc:407] Connection header received
0808 21:01:17.413275 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.413276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.413293 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.413347 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:17.413840 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.414337 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.415055 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.415245 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.415322 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.417521 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:17.417522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:17.417523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:17.417530 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:17.418791 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.419238 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.419239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.419239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.419308 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.419518 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.419519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.419519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.419645 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:17.419718 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.419882 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.419973 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:01:17.420212 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.412875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37967 (local address 127.0.0.1:56432)
0808 21:01:17.413065 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.413075 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.413184 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.413367 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.413368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.413703 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:17.413754 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.413757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.414436 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.414437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.414969 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.414970 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.415332 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.415333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.415395 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.415934 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:17.415939 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:17.417399 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:17.418928 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:17.418937 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:17.418939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:17.419150 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:17.419385 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:17.419386 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:17.419386 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:17.419446 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:17.419721 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:17.419729 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:17.419780 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.419855 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.420046 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":80,"thread_start_us":86,"threads_started":1}
I20260808 21:01:17.422474 16751 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:56432:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 21:01:17.422801 16751 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:17.424449 16968 tablet_service.cc:1467] Processing CreateTablet for tablet b39728929b8b499480b09ddc6aec3a52 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93dea0a20dac4fdd9db0929d480f98a2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:17.424451 17226 tablet_service.cc:1467] Processing CreateTablet for tablet b39728929b8b499480b09ddc6aec3a52 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93dea0a20dac4fdd9db0929d480f98a2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:17.424687 16968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39728929b8b499480b09ddc6aec3a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.424698 17226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39728929b8b499480b09ddc6aec3a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.426018 17617 tablet_bootstrap.cc:492] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: Bootstrap starting.
I20260808 21:01:17.426030 17622 tablet_bootstrap.cc:492] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: Bootstrap starting.
I20260808 21:01:17.426417 17617 tablet_bootstrap.cc:654] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.426429 17622 tablet_bootstrap.cc:654] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.426997 17466 tablet_service.cc:1467] Processing CreateTablet for tablet b39728929b8b499480b09ddc6aec3a52 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93dea0a20dac4fdd9db0929d480f98a2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:17.427057 17617 tablet_bootstrap.cc:492] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: No bootstrap required, opened a new log
I20260808 21:01:17.427098 17617 ts_tablet_manager.cc:1397] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:17.427152 17466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b39728929b8b499480b09ddc6aec3a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:17.427162 17622 tablet_bootstrap.cc:492] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: No bootstrap required, opened a new log
I20260808 21:01:17.427196 17622 ts_tablet_manager.cc:1397] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:17.427251 17617 raft_consensus.cc:348] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.427320 17617 raft_consensus.cc:374] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.427305 17622 raft_consensus.cc:348] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.427340 17617 raft_consensus.cc:729] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 004e5b5d0274444781d54bcd13e685d2, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.427351 17622 raft_consensus.cc:374] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.427366 17622 raft_consensus.cc:729] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 808b40f24c954481b3f1da0b9bc02cf3, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.427390 17617 consensus_queue.cc:260] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.427423 17622 consensus_queue.cc:260] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.427484 17617 ts_tablet_manager.cc:1428] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:17.427513 17622 ts_tablet_manager.cc:1428] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:17.427541 17623 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.427654 17623 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:17.427652 17627 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.427721 17627 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:17.428727 17618 tablet_bootstrap.cc:492] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: Bootstrap starting.
I20260808 21:01:17.429071 17618 tablet_bootstrap.cc:654] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:17.429593 17618 tablet_bootstrap.cc:492] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: No bootstrap required, opened a new log
I20260808 21:01:17.429638 17618 ts_tablet_manager.cc:1397] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:17.429764 17618 raft_consensus.cc:348] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.429821 17618 raft_consensus.cc:374] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:17.429834 17618 raft_consensus.cc:729] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0f031f8c3148c995afa4b80c14aa56, State: Initialized, Role: FOLLOWER
I20260808 21:01:17.429898 17618 consensus_queue.cc:260] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.429998 17618 ts_tablet_manager.cc:1428] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:17.430028 17633 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.430104 17633 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:17.489719 17623 raft_consensus.cc:482] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:17.489815 17623 raft_consensus.cc:504] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.490159 17623 leader_election.cc:288] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611), 0f0f031f8c3148c995afa4b80c14aa56 (127.14.146.195:41047)
I20260808 21:01:17.491045 17627 raft_consensus.cc:482] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:17.491147 17627 raft_consensus.cc:504] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.491464 17627 leader_election.cc:288] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194:41841), 0f0f031f8c3148c995afa4b80c14aa56 (127.14.146.195:41047)
I20260808 21:01:17.494333 17678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.490333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42611 (local address 127.14.146.194:60515)
0808 21:01:17.490465 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.490477 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.490539 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.490706 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.490707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.490709 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.490796 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.490800 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.491771 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.491773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.493228 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.493231 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.494033 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.494034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.494113 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.494117 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.494164 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.494215 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":56,"thread_start_us":72,"threads_started":1}
I20260808 21:01:17.494454 17614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.490590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:54071 (local address 127.14.146.195:41047)
0808 21:01:17.490645 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.490648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.490733 (+ 85us) server_negotiation.cc:407] Connection header received
0808 21:01:17.490763 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.490764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.490775 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.490827 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.491004 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.491693 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.493384 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.493982 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.494064 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.494090 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.494345 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.494386 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:01:17.494630 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.490431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:60515 (local address 127.14.146.193:42611)
0808 21:01:17.490484 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.490486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.490534 (+ 48us) server_negotiation.cc:407] Connection header received
0808 21:01:17.490603 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.490605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.490616 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.490692 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.490902 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.491690 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.493318 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.493887 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.493952 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.493961 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.494513 (+ 552us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.494568 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 21:01:17.494678 17680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.490526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41047 (local address 127.14.146.194:54071)
0808 21:01:17.490638 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.490653 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.490719 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.490851 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.490851 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.490853 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.490912 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.490913 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.491854 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.491855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.493269 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.493271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.494179 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.494180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.494258 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.494262 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.494545 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.494595 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":123,"thread_start_us":73,"threads_started":1}
I20260808 21:01:17.494845 17002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39728929b8b499480b09ddc6aec3a52" candidate_uuid: "004e5b5d0274444781d54bcd13e685d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "808b40f24c954481b3f1da0b9bc02cf3" is_pre_election: true
I20260808 21:01:17.494925 17002 raft_consensus.cc:2454] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004e5b5d0274444781d54bcd13e685d2 in term 0.
I20260808 21:01:17.494954 17504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39728929b8b499480b09ddc6aec3a52" candidate_uuid: "004e5b5d0274444781d54bcd13e685d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0f031f8c3148c995afa4b80c14aa56" is_pre_election: true
I20260808 21:01:17.495085 17504 raft_consensus.cc:2454] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 004e5b5d0274444781d54bcd13e685d2 in term 0.
I20260808 21:01:17.495271 17141 leader_election.cc:302] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004e5b5d0274444781d54bcd13e685d2, 0f0f031f8c3148c995afa4b80c14aa56; no voters:
I20260808 21:01:17.495388 17623 raft_consensus.cc:2781] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:17.495437 17623 raft_consensus.cc:482] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:17.495464 17623 raft_consensus.cc:3037] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.496449 17683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.491567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:41841 (local address 127.14.146.193:48165)
0808 21:01:17.491939 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.491951 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.492029 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.492198 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.492199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.492200 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.493065 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.493069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.494076 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.494077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.495417 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.495421 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.496205 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.496206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.496278 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.496286 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.496332 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.496371 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":63,"threads_started":1}
I20260808 21:01:17.496439 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.491846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:48165 (local address 127.14.146.194:41841)
0808 21:01:17.491889 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.491891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.492009 (+ 118us) server_negotiation.cc:407] Connection header received
0808 21:01:17.492120 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.492128 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.492137 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.492194 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.493170 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.493900 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.495530 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.496017 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.496103 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.496111 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.496354 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.496390 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:01:17.496443 17623 raft_consensus.cc:504] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.496608 17623 leader_election.cc:288] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [CANDIDATE]: Term 1 election: Requested vote from peers 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611), 0f0f031f8c3148c995afa4b80c14aa56 (127.14.146.195:41047)
I20260808 21:01:17.496572 17684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.491655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41047 (local address 127.14.146.193:41575)
0808 21:01:17.492948 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.492959 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.493029 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.493222 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.493223 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.493225 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:17.493293 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.493295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.494265 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.494266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.495452 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.495456 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.496288 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.496289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.496374 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.496378 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.496441 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.496484 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1270,"thread_start_us":91,"threads_started":1}
I20260808 21:01:17.496775 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.491846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:41575 (local address 127.14.146.195:41047)
0808 21:01:17.491968 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.491970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.493082 (+ 1112us) server_negotiation.cc:407] Connection header received
0808 21:01:17.493109 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.493110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.493120 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.493180 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:17.493366 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.494162 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.495562 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.496200 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.496270 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.496278 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.496629 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.496681 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":102,"thread_start_us":72,"threads_started":1}
I20260808 21:01:17.496817 17504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39728929b8b499480b09ddc6aec3a52" candidate_uuid: "004e5b5d0274444781d54bcd13e685d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0f031f8c3148c995afa4b80c14aa56"
I20260808 21:01:17.496802 17256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39728929b8b499480b09ddc6aec3a52" candidate_uuid: "808b40f24c954481b3f1da0b9bc02cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "004e5b5d0274444781d54bcd13e685d2" is_pre_election: true
I20260808 21:01:17.496878 17504 raft_consensus.cc:3037] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.496901 17256 raft_consensus.cc:2379] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 808b40f24c954481b3f1da0b9bc02cf3 in current term 1: Already voted for candidate 004e5b5d0274444781d54bcd13e685d2 in this term.
I20260808 21:01:17.497263 17002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39728929b8b499480b09ddc6aec3a52" candidate_uuid: "004e5b5d0274444781d54bcd13e685d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "808b40f24c954481b3f1da0b9bc02cf3"
I20260808 21:01:17.497291 17502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b39728929b8b499480b09ddc6aec3a52" candidate_uuid: "808b40f24c954481b3f1da0b9bc02cf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f0f031f8c3148c995afa4b80c14aa56" is_pre_election: true
I20260808 21:01:17.497346 17002 raft_consensus.cc:3037] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:17.497571 16895 leader_election.cc:302] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 808b40f24c954481b3f1da0b9bc02cf3; no voters: 004e5b5d0274444781d54bcd13e685d2, 0f0f031f8c3148c995afa4b80c14aa56
I20260808 21:01:17.497812 17504 raft_consensus.cc:2454] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004e5b5d0274444781d54bcd13e685d2 in term 1.
I20260808 21:01:17.497980 17141 leader_election.cc:302] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 004e5b5d0274444781d54bcd13e685d2, 0f0f031f8c3148c995afa4b80c14aa56; no voters:
I20260808 21:01:17.498075 17623 raft_consensus.cc:2781] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:17.498162 17002 raft_consensus.cc:2454] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 004e5b5d0274444781d54bcd13e685d2 in term 1.
I20260808 21:01:17.498191 17623 raft_consensus.cc:686] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [term 1 LEADER]: Becoming Leader. State: Replica: 004e5b5d0274444781d54bcd13e685d2, State: Running, Role: LEADER
I20260808 21:01:17.498243 17627 raft_consensus.cc:2726] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 21:01:17.498294 17623 consensus_queue.cc:237] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } }
I20260808 21:01:17.498687 17687 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: TxnStatusTablet state changed. Reason: New leader 004e5b5d0274444781d54bcd13e685d2. Latest consensus state: current_term: 1 leader_uuid: "004e5b5d0274444781d54bcd13e685d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.498798 17687 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:17.498977 17689 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 21:01:17.499089 17689 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 21:01:17.498992 16750 catalog_manager.cc:5495] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "004e5b5d0274444781d54bcd13e685d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:17.522347 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.519436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44942 (local address 127.14.146.194:41841)
0808 21:01:17.519499 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.519501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.519511 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:17.519648 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.519650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.519670 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.519745 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:17.519885 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.520678 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.521479 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.521699 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.521776 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.521966 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:17.522075 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:17.522183 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.522247 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.522267 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:01:17.522357 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.519340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:41841 (local address 127.0.0.1:44942)
0808 21:01:17.519433 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.519444 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.519516 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.519762 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.519763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.519764 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:17.519813 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.519815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.520752 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.520753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.521375 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.521396 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.521788 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.521789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.521854 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.521868 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:17.522172 (+ 304us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:17.522183 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.522241 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.522290 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 21:01:17.523844 17002 raft_consensus.cc:1261] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Refusing update from remote peer 004e5b5d0274444781d54bcd13e685d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:17.523823 17504 raft_consensus.cc:1261] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 FOLLOWER]: Refusing update from remote peer 004e5b5d0274444781d54bcd13e685d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:17.524152 17687 consensus_queue.cc:1035] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:17.524277 17623 consensus_queue.cc:1035] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:17.524935 17633 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: TxnStatusTablet state changed. Reason: New leader 004e5b5d0274444781d54bcd13e685d2. Latest consensus state: current_term: 1 leader_uuid: "004e5b5d0274444781d54bcd13e685d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.525035 17633 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:17.525255 17627 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: TxnStatusTablet state changed. Reason: New leader 004e5b5d0274444781d54bcd13e685d2. Latest consensus state: current_term: 1 leader_uuid: "004e5b5d0274444781d54bcd13e685d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.525344 17627 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:17.526007 17687 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "004e5b5d0274444781d54bcd13e685d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.526037 17623 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "004e5b5d0274444781d54bcd13e685d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.526096 17687 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:17.526116 17623 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 004e5b5d0274444781d54bcd13e685d2: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:17.527336 17633 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "004e5b5d0274444781d54bcd13e685d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.527436 17633 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 0f0f031f8c3148c995afa4b80c14aa56: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:17.527648 17627 tablet_replica.cc:439] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "004e5b5d0274444781d54bcd13e685d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 } } peers { permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 } } peers { permanent_uuid: "0f0f031f8c3148c995afa4b80c14aa56" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41047 } } }
I20260808 21:01:17.527732 17627 tablet_replica.cc:442] T b39728929b8b499480b09ddc6aec3a52 P 808b40f24c954481b3f1da0b9bc02cf3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:17.532677 17608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.530266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:57393 (local address 127.14.146.194:41841)
0808 21:01:17.530310 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.530312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.530417 (+ 105us) server_negotiation.cc:407] Connection header received
0808 21:01:17.530494 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.530495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.530506 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.530555 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:17.530675 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.531167 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.531944 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.532167 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.532245 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.532428 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:17.532466 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:17.532521 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.532591 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.532611 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:01:17.532739 17703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.530191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:41841 (local address 127.14.146.195:57393)
0808 21:01:17.530343 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.530354 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.530435 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.530557 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.530557 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.530559 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:17.530608 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.530609 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.531255 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.531256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.531855 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.531857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.532247 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.532248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.532319 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.532333 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:17.532535 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:17.532537 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.532586 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.532645 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":77,"threads_started":1}
I20260808 21:01:17.535329 17002 raft_consensus.cc:1261] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Refusing update from remote peer 0f0f031f8c3148c995afa4b80c14aa56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:17.535356 17256 raft_consensus.cc:1261] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Refusing update from remote peer 0f0f031f8c3148c995afa4b80c14aa56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:17.535598 17633 consensus_queue.cc:1035] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "004e5b5d0274444781d54bcd13e685d2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:17.535696 17625 consensus_queue.cc:1035] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "808b40f24c954481b3f1da0b9bc02cf3" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:17.544391 17685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.541500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:57835 (local address 127.14.146.195:41047)
0808 21:01:17.541712 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.541714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.541784 (+ 70us) server_negotiation.cc:407] Connection header received
0808 21:01:17.541855 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.541856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.541867 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.541912 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:17.542049 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.542565 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.543634 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.543842 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.543930 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.544158 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:17.544191 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:17.544243 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.544300 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.544323 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185}
I20260808 21:01:17.544426 17709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.541535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41047 (local address 127.14.146.194:57835)
0808 21:01:17.541723 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:17.541734 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:17.541797 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:17.541912 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:17.541913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:17.541914 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:17.541981 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.541982 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.542658 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.542659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.543541 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:17.543544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.543932 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.543933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:17.544007 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.544025 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:17.544252 (+ 227us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:17.544254 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:17.544298 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 21:01:17.544341 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":108,"threads_started":1}
I20260808 21:01:17.552712 16751 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:17.552815 16751 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56418:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:17.553433 16751 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca3a714b91c144459d7c3d95da42f332: Sending DeleteTablet for 3 replicas of tablet 0b0d1b8f3a7648ec81f29f65a24c63c4
I20260808 21:01:17.553714 16968 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:17 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:60190
I20260808 21:01:17.553835 17657 tablet_replica.cc:330] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: stopping tablet replica
I20260808 21:01:17.553838 17466 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:17 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:42918
I20260808 21:01:17.553896 17657 raft_consensus.cc:2229] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:17.553913 17655 tablet_replica.cc:330] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: stopping tablet replica
I20260808 21:01:17.553939 17657 raft_consensus.cc:2258] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:17.553957 17655 raft_consensus.cc:2229] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:17.554013 17655 raft_consensus.cc:2258] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:17.554311 17655 ts_tablet_manager.cc:1905] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:17.554311 17657 ts_tablet_manager.cc:1905] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:17.556030 17226 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:17 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:44940
I20260808 21:01:17.556224 17653 tablet_replica.cc:330] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: stopping tablet replica
I20260808 21:01:17.556277 17655 ts_tablet_manager.cc:1918] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:17.556303 17653 raft_consensus.cc:2229] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:17.556335 17655 log.cc:1196] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/0b0d1b8f3a7648ec81f29f65a24c63c4
I20260808 21:01:17.556356 17653 raft_consensus.cc:2258] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:17.556619 17655 ts_tablet_manager.cc:1939] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 0f0f031f8c3148c995afa4b80c14aa56: Deleting consensus metadata
I20260808 21:01:17.556663 17653 ts_tablet_manager.cc:1905] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:17.556985 17657 ts_tablet_manager.cc:1918] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:17.557003 16730 catalog_manager.cc:4841] TS 0f0f031f8c3148c995afa4b80c14aa56 (127.14.146.195:41047): tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 (table test-table [id=c5a820ddc3bf443eba9f2157128e3eaf]) successfully deleted
I20260808 21:01:17.557050 17657 log.cc:1196] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/0b0d1b8f3a7648ec81f29f65a24c63c4
I20260808 21:01:17.557212 17657 ts_tablet_manager.cc:1939] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 808b40f24c954481b3f1da0b9bc02cf3: Deleting consensus metadata
I20260808 21:01:17.557492 16730 catalog_manager.cc:4841] TS 808b40f24c954481b3f1da0b9bc02cf3 (127.14.146.193:42611): tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 (table test-table [id=c5a820ddc3bf443eba9f2157128e3eaf]) successfully deleted
I20260808 21:01:17.558324 17653 ts_tablet_manager.cc:1918] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:17.558400 17653 log.cc:1196] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/0b0d1b8f3a7648ec81f29f65a24c63c4
I20260808 21:01:17.558634 17653 ts_tablet_manager.cc:1939] T 0b0d1b8f3a7648ec81f29f65a24c63c4 P 004e5b5d0274444781d54bcd13e685d2: Deleting consensus metadata
I20260808 21:01:17.559008 16731 catalog_manager.cc:4841] TS 004e5b5d0274444781d54bcd13e685d2 (127.14.146.194:41841): tablet 0b0d1b8f3a7648ec81f29f65a24c63c4 (table test-table [id=c5a820ddc3bf443eba9f2157128e3eaf]) successfully deleted
Aug 08 21:01:17 dist-test-slave-t3q3 krb5kdc[16685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222877, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:17.566758 17616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.557598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60206 (local address 127.14.146.193:42611)
0808 21:01:17.557648 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.557650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.557870 (+ 220us) server_negotiation.cc:407] Connection header received
0808 21:01:17.557918 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.557918 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.557929 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.557998 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:17.558638 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.559436 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.560209 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.560513 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.560616 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.563748 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:17.563759 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:17.563760 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:17.563767 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:17.565637 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.565967 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.565971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.565971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.566056 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.566236 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.566236 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.566237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.566399 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:17.566542 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.566585 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.566663 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260808 21:01:17.567245 17075 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60206
I20260808 21:01:17.574363 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:17.568304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56442 (local address 127.14.146.254:37967)
0808 21:01:17.568354 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:17.568356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:17.568395 (+ 39us) server_negotiation.cc:407] Connection header received
0808 21:01:17.568476 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:17.568477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:17.568487 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:17.568538 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:17.569128 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.569679 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.570373 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:17.570585 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:17.570661 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:17.571838 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:17.571839 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:17.571840 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:17.571847 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:17.573210 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.573562 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.573564 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.573564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.573625 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:17.573837 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:17.573837 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:17.573838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:17.573959 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:17.574064 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:17.574171 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 21:01:17.574251 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 21:01:17.574622 16751 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56442
I20260808 21:01:17.575398 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16864
I20260808 21:01:17.591074 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17097
I20260808 21:01:17.610241 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17358
I20260808 21:01:17.620791 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16703
2026-08-08T21:01:17Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2655 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:17 dist-test-slave-t3q3 krb5kdc[17722](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:17 dist-test-slave-t3q3 krb5kdc[17722](info): set up 2 sockets
Aug 08 21:01:17 dist-test-slave-t3q3 krb5kdc[17722](info): commencing operation
krb5kdc: starting...
W20260808 21:01:18.929378 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:19.051307 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:35615
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:39415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:35615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:19.134303 17742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:19.134516 17742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:19.134541 17742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:19.135617 17742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:19.135653 17742 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 21:01:19.135665 17742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:19.135679 17742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:19.135692 17742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:19.135704 17742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:19.137151 17742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:35615
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:35615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:19.137349 17742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:19.137514 17742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:19.142395 17755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:19.142421 17751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:19.142396 17747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:19.142584 17742 server_base.cc:1034] running on GCE node
I20260808 21:01:19.142859 17742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:19.143173 17742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:19.144340 17742 hybrid_clock.cc:648] HybridClock initialized: now 1786222879144330 us; error 37 us; skew 500 ppm
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:19.146883 17742 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:19.147343 17742 webserver.cc:460] Webserver started at http://127.14.146.254:37591/ using document root <none> and password file <none>
I20260808 21:01:19.147585 17742 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:19.147670 17742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:19.147827 17742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:19.148952 17742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "afc9f2060afa47f6a926948d5d3fca92"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "a033a22fd74e31f4a3b943603d090dcf"
server_key_iv: "5812fbd7819742a3437e1c4e411557b8"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.149331 17742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "afc9f2060afa47f6a926948d5d3fca92"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "a033a22fd74e31f4a3b943603d090dcf"
server_key_iv: "5812fbd7819742a3437e1c4e411557b8"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.150717 17742 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:01:19.151467 17767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.151664 17742 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:19.151767 17742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "afc9f2060afa47f6a926948d5d3fca92"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "a033a22fd74e31f4a3b943603d090dcf"
server_key_iv: "5812fbd7819742a3437e1c4e411557b8"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.151854 17742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:19.179562 17742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:19.181520 17742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:19.181702 17742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:19.186602 17742 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:35615
I20260808 21:01:19.186702 17862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:35615 every 8 connection(s)
I20260808 21:01:19.186997 17742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:19.187623 17864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:19.190062 17864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: Bootstrap starting.
I20260808 21:01:19.190793 17864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:19.191181 17864 log.cc:824] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:19.191851 17864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: No bootstrap required, opened a new log
I20260808 21:01:19.194119 17864 raft_consensus.cc:348] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc9f2060afa47f6a926948d5d3fca92" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35615 } }
I20260808 21:01:19.194257 17864 raft_consensus.cc:374] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:19.194279 17864 raft_consensus.cc:729] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afc9f2060afa47f6a926948d5d3fca92, State: Initialized, Role: FOLLOWER
I20260808 21:01:19.194380 17864 consensus_queue.cc:260] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc9f2060afa47f6a926948d5d3fca92" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35615 } }
I20260808 21:01:19.194429 17864 raft_consensus.cc:388] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:19.194450 17864 raft_consensus.cc:482] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:19.194481 17864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:19.194977 17864 raft_consensus.cc:504] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc9f2060afa47f6a926948d5d3fca92" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35615 } }
I20260808 21:01:19.195073 17864 leader_election.cc:302] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afc9f2060afa47f6a926948d5d3fca92; no voters:
I20260808 21:01:19.195194 17864 leader_election.cc:288] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:19.195245 17869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:19.195417 17869 raft_consensus.cc:686] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [term 1 LEADER]: Becoming Leader. State: Replica: afc9f2060afa47f6a926948d5d3fca92, State: Running, Role: LEADER
I20260808 21:01:19.195447 17864 sys_catalog.cc:564] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:19.195514 17869 consensus_queue.cc:237] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc9f2060afa47f6a926948d5d3fca92" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35615 } }
I20260808 21:01:19.195933 17870 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afc9f2060afa47f6a926948d5d3fca92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc9f2060afa47f6a926948d5d3fca92" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35615 } } }
I20260808 21:01:19.196035 17870 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:19.196216 17872 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afc9f2060afa47f6a926948d5d3fca92. Latest consensus state: current_term: 1 leader_uuid: "afc9f2060afa47f6a926948d5d3fca92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afc9f2060afa47f6a926948d5d3fca92" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35615 } } }
I20260808 21:01:19.196296 17872 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:19.196550 17880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:19.196792 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17742
I20260808 21:01:19.196863 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:19.196983 14923 external_mini_cluster.cc:1428] Setting key 8a198805fd641bde8993694a172327e5
I20260808 21:01:19.197538 17880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:19.199214 17880 catalog_manager.cc:1347] Generated new cluster ID: 379228d11c46492cab6e5f819ee26797
I20260808 21:01:19.199265 17880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:19.208786 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.197576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39698 (local address 127.14.146.254:35615)
0808 21:01:19.197844 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.197945 (+ 101us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.197978 (+ 33us) server_negotiation.cc:407] Connection header received
0808 21:01:19.198146 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.198154 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.198208 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.198351 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.199158 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.200599 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.201653 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.202298 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.202427 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.205157 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.205162 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.205162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.205174 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.207092 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.207492 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.207494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.207495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.207628 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.207849 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.207850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.207850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.208160 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.208298 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.208433 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.208561 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":74,"threads_started":1}
I20260808 21:01:19.211000 17880 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:19.211505 17880 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:19.222018 17880 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: Generated new TSK 0
I20260808 21:01:19.222193 17880 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:19.250918 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:35615
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:39415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:19.333871 17902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:19.334129 17902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:19.334175 17902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:19.335300 17902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:19.335369 17902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:19.335404 17902 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 21:01:19.335456 17902 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:19.335494 17902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:19.336975 17902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:35615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:19.337253 17902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:19.337497 17902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:19.342772 17913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:19.342787 17917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:19.342783 17912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:19.342923 17902 server_base.cc:1034] running on GCE node
I20260808 21:01:19.343147 17902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:19.343350 17902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:19.344521 17902 hybrid_clock.cc:648] HybridClock initialized: now 1786222879344505 us; error 27 us; skew 500 ppm
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:19.347146 17902 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:19.347532 17902 webserver.cc:460] Webserver started at http://127.14.146.193:38327/ using document root <none> and password file <none>
I20260808 21:01:19.347774 17902 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:19.347822 17902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:19.347956 17902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:19.349038 17902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "cd52192f6f4f4595b82ea0115cb7f283"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "b53c8fd4f48d16cf990952135cd705b0"
server_key_iv: "73291f274dd2cb7e97d185366371af76"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.349406 17902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "cd52192f6f4f4595b82ea0115cb7f283"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "b53c8fd4f48d16cf990952135cd705b0"
server_key_iv: "73291f274dd2cb7e97d185366371af76"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.350736 17902 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:01:19.351436 17929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.351641 17902 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:19.351727 17902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "cd52192f6f4f4595b82ea0115cb7f283"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "b53c8fd4f48d16cf990952135cd705b0"
server_key_iv: "73291f274dd2cb7e97d185366371af76"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.351781 17902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:19.374755 17902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:19.377024 17902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:19.377141 17902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:19.377630 17902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:19.377665 17902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.377688 17902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:19.377705 17902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.384724 17902 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:34113
I20260808 21:01:19.384809 18133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:34113 every 8 connection(s)
I20260808 21:01:19.385097 17902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:19.386516 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17902
I20260808 21:01:19.386617 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:19.386849 14923 external_mini_cluster.cc:1428] Setting key 9f16a5fedea73ce5b323783976fd2f9a
I20260808 21:01:19.388972 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.378248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:35615 (local address 127.14.146.193:57417)
0808 21:01:19.378435 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.378481 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.379061 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.379398 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.379402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.379801 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:19.380168 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.380174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.381261 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.381262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.382712 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.382715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.383173 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.383174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.383337 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.383918 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:19.383928 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:19.385837 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:19.387583 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.387590 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.387592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.387814 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.388045 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.388045 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.388046 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.388204 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.388501 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:19.388506 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:19.388617 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.388702 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.388821 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260808 21:01:19.389009 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.378318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:57417 (local address 127.14.146.254:35615)
0808 21:01:19.378370 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.378373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.378578 (+ 205us) server_negotiation.cc:407] Connection header received
0808 21:01:19.379211 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.379213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.379227 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.379302 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.380289 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.381161 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.382792 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.383068 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.383161 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.385929 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.385931 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.385931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.385938 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.387489 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.387904 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.387906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.387906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.387973 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.388275 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.388276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.388277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.388430 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.388505 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.388766 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.388867 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:01:19.389981 18134 heartbeater.cc:347] Connected to a master server at 127.14.146.254:35615
I20260808 21:01:19.390085 18134 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:19.390278 18134 heartbeater.cc:511] Master 127.14.146.254:35615 requested a full tablet report, sending...
I20260808 21:01:19.390795 17789 ts_manager.cc:194] Registered new tserver with Master: cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113)
I20260808 21:01:19.391661 17789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:57417
I20260808 21:01:19.397751 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.391003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:51267 (local address 127.14.146.254:35615)
0808 21:01:19.391052 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.391054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.391221 (+ 167us) server_negotiation.cc:407] Connection header received
0808 21:01:19.391418 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.391419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.391429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.391484 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.391842 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.392493 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.393653 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.393830 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.393886 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.394928 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.394930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.394930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.394935 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.396548 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.397000 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.397000 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.397001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.397084 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.397319 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.397320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.397320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.397416 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.397463 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.397636 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.397693 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:01:19.397857 18145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.390960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:35615 (local address 127.14.146.193:51267)
0808 21:01:19.391137 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.391148 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.391219 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.391493 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.391494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.391704 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:19.391774 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.391776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.392591 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.392592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.393562 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.393565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.393914 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.393915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.394007 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.394404 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:19.394410 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:19.394832 (+ 422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:19.396625 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.396626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.396626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.396919 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.397169 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.397170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.397171 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.397243 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.397484 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:19.397486 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:19.397538 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.397619 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.397723 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:19.415742 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:35615
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:39415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:19.500226 18147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:19.500460 18147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:19.500506 18147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:19.501650 18147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:19.501719 18147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:19.501753 18147 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 21:01:19.501782 18147 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:19.501816 18147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:19.503270 18147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:35615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:19.503539 18147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:19.503779 18147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:19.508782 18156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:19.508788 18158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:19.508809 18155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:19.509109 18147 server_base.cc:1034] running on GCE node
I20260808 21:01:19.509310 18147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:19.509545 18147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:19.510757 18147 hybrid_clock.cc:648] HybridClock initialized: now 1786222879510750 us; error 36 us; skew 500 ppm
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:19.513240 18147 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:19.513669 18147 webserver.cc:460] Webserver started at http://127.14.146.194:36501/ using document root <none> and password file <none>
I20260808 21:01:19.513885 18147 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:19.513950 18147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:19.514092 18147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:19.515100 18147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "8fa470df762c4932b480b4c78fce4649"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "f3b06c8e089283aefc66fdd79fa1913e"
server_key_iv: "373c7e08a2c9aed536943e7d84b599da"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.515457 18147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "8fa470df762c4932b480b4c78fce4649"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "f3b06c8e089283aefc66fdd79fa1913e"
server_key_iv: "373c7e08a2c9aed536943e7d84b599da"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.516863 18147 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:19.517558 18172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.517746 18147 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:19.517849 18147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "8fa470df762c4932b480b4c78fce4649"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "f3b06c8e089283aefc66fdd79fa1913e"
server_key_iv: "373c7e08a2c9aed536943e7d84b599da"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.517918 18147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:19.537359 18147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:19.539425 18147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:19.539587 18147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:19.540197 18147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:19.540247 18147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.540270 18147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:19.540283 18147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.547224 18147 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:33619
I20260808 21:01:19.547298 18350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:33619 every 8 connection(s)
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:19.547621 18147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:19.550771 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.540683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:38171 (local address 127.14.146.254:35615)
0808 21:01:19.540748 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.540750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.540990 (+ 240us) server_negotiation.cc:407] Connection header received
0808 21:01:19.541549 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.541550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.541563 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.541630 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.542488 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.543348 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.544702 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.545053 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.545139 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.547924 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.547926 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.547926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.547935 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.549509 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.549924 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.549926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.549926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.550000 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.550247 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.550248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.550248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.550360 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.550415 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.550639 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.550707 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:01:19.550944 18184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.540682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:35615 (local address 127.14.146.194:38171)
0808 21:01:19.540853 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.540894 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.541428 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.541708 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.541712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.542070 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:19.542363 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.542370 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.543472 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.543473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.544588 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.544591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.545171 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.545172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.545323 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.545923 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:19.545934 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:19.547796 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:19.549590 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.549596 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.549597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.549825 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.550080 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.550081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.550081 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.550185 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.550418 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:19.550423 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:19.550535 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.550617 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.550746 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":110,"threads_started":1}
I20260808 21:01:19.551416 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 18147
I20260808 21:01:19.551512 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:19.551534 18352 heartbeater.cc:347] Connected to a master server at 127.14.146.254:35615
I20260808 21:01:19.551623 18352 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:19.551717 14923 external_mini_cluster.cc:1428] Setting key d99a46a422b8a984d64cd7fdb58bbb14
I20260808 21:01:19.551821 18352 heartbeater.cc:511] Master 127.14.146.254:35615 requested a full tablet report, sending...
I20260808 21:01:19.552417 17789 ts_manager.cc:194] Registered new tserver with Master: 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619)
I20260808 21:01:19.552942 17789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:38171
I20260808 21:01:19.559011 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.552562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:35615 (local address 127.14.146.194:34335)
0808 21:01:19.552722 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.552735 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.552800 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.552913 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.552913 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.553153 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:19.553227 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.553229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.554060 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.554062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.554840 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.554843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.555355 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.555356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.555437 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.555879 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:19.555883 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:19.556206 (+ 323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:19.557974 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.557975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.557975 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.558133 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.558348 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.558349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.558349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.558401 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.558756 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:19.558757 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:19.558792 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.558842 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.558939 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260808 21:01:19.559092 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.552719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:34335 (local address 127.14.146.254:35615)
0808 21:01:19.552755 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.552756 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.552785 (+ 29us) server_negotiation.cc:407] Connection header received
0808 21:01:19.552846 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.552846 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.552855 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.552907 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.553336 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.553954 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.554921 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.555224 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.555328 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.556285 (+ 957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.556286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.556287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.556294 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.557888 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.558207 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.558209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.558209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.558274 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.558464 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.558465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.558465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.558684 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.558765 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.558875 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.558960 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:19.578845 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:35615
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:39415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:19.662111 18375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:19.662323 18375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:19.662348 18375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:19.663400 18375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:19.663439 18375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:19.663458 18375 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 21:01:19.663470 18375 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:19.663486 18375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:19.664896 18375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:35615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:19.665083 18375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:19.665256 18375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:19.670481 18384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:19.670502 18388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:19.670497 18385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:19.670717 18375 server_base.cc:1034] running on GCE node
I20260808 21:01:19.670998 18375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:19.671247 18375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:19.672411 18375 hybrid_clock.cc:648] HybridClock initialized: now 1786222879672388 us; error 51 us; skew 500 ppm
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:19.675514 18375 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:19.675956 18375 webserver.cc:460] Webserver started at http://127.14.146.195:40455/ using document root <none> and password file <none>
I20260808 21:01:19.676262 18375 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:19.676312 18375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:19.676566 18375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:19.677685 18375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "960e6517ee974f6e93dd6f1fcefa933d"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "3537895e8020e09e3fc53cd3fed23a68"
server_key_iv: "e6a227c385b84ebf191f267755fe5abc"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.678077 18375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "960e6517ee974f6e93dd6f1fcefa933d"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "3537895e8020e09e3fc53cd3fed23a68"
server_key_iv: "e6a227c385b84ebf191f267755fe5abc"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.679457 18375 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:19.680347 18405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.680536 18375 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:19.680629 18375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "960e6517ee974f6e93dd6f1fcefa933d"
format_stamp: "Formatted at 2026-08-08 21:01:19 on dist-test-slave-t3q3"
server_key: "3537895e8020e09e3fc53cd3fed23a68"
server_key_iv: "e6a227c385b84ebf191f267755fe5abc"
server_key_version: "encryptionkey@0"
I20260808 21:01:19.680712 18375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:19.706712 18375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:19.708729 18375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:19.708897 18375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:19.709457 18375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:19.709499 18375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.709522 18375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:19.709535 18375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:19.716672 18375 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:42531
I20260808 21:01:19.716866 18600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:42531 every 8 connection(s)
I20260808 21:01:19.717101 18375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:19.719645 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.709953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:45737 (local address 127.14.146.254:35615)
0808 21:01:19.710021 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.710024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.710215 (+ 191us) server_negotiation.cc:407] Connection header received
0808 21:01:19.710766 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.710767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.710781 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.710846 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.711826 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.712666 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.714405 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.714615 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.714705 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.717000 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.717001 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.717001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.717010 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.718508 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.718859 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.718859 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.718860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.718911 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.719117 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.719118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.719118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.719231 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.719281 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.719514 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.719577 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 21:01:19.719797 18424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.709936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:35615 (local address 127.14.146.195:45737)
0808 21:01:19.710103 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.710143 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.710649 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.710968 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.710974 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.711388 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:19.711706 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.711713 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.712762 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.712764 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.714307 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.714310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.714717 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.714718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.714853 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.715345 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:19.715355 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:19.716912 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:19.718577 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.718582 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.718583 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.718791 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.718969 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.718969 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.718969 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.719063 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.719286 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:19.719291 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:19.719399 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.719485 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.719601 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":100,"threads_started":1}
I20260808 21:01:19.720278 18601 heartbeater.cc:347] Connected to a master server at 127.14.146.254:35615
I20260808 21:01:19.720381 18601 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:19.720583 18601 heartbeater.cc:511] Master 127.14.146.254:35615 requested a full tablet report, sending...
I20260808 21:01:19.721001 17789 ts_manager.cc:194] Registered new tserver with Master: 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:19.721513 17789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:45737
I20260808 21:01:19.724562 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 18375
I20260808 21:01:19.724671 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:19.724855 14923 external_mini_cluster.cc:1428] Setting key 1f1da374aa0acab415ef16f9d4f81042
I20260808 21:01:19.725734 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:01:19.727231 18612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.721317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:35615 (local address 127.14.146.195:53331)
0808 21:01:19.721467 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.721477 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.721541 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.721721 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.721722 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.721890 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:19.721965 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.721966 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.722711 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.722712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.723222 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.723223 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.723587 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.723587 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.723661 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.724024 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:19.724028 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:19.724380 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:19.726248 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.726249 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.726249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.726415 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.726631 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.726632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.726632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.726682 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.726966 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:19.726967 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:19.727007 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.727066 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.727145 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":100,"threads_started":1}
I20260808 21:01:19.727344 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.721406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:53331 (local address 127.14.146.254:35615)
0808 21:01:19.721449 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.721451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.721531 (+ 80us) server_negotiation.cc:407] Connection header received
0808 21:01:19.721618 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.721619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.721630 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.721677 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.722052 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.722617 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.723316 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.723514 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.723586 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.724469 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.724471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.724471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.724478 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.726153 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.726489 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.726490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.726490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.726559 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.726748 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.726750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.726750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.726894 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.726965 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.727115 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.727208 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:19.750175 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.743243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35740 (local address 127.14.146.254:35615)
0808 21:01:19.743311 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.743313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.743323 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:19.743355 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.743356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.743365 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.743430 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.744005 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.744559 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.745339 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.745535 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.745626 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.747962 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.747963 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.747964 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.747970 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.749243 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.749559 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.749560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.749560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.749611 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.749773 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.749774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.749774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.749878 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.749952 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.750049 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.750109 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:01:19.751745 17789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:19.753683 17789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:19.760176 18634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.756160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:33619 (local address 127.0.0.1:40918)
0808 21:01:19.756500 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.756510 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.756564 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.756905 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.756909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.756911 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:19.756978 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.756981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.757867 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.757869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.758977 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.758979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.759842 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.759843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.759925 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.759937 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.760033 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.760109 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":2,"thread_start_us":77,"threads_started":1}
I20260808 21:01:19.760237 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.756433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40918 (local address 127.14.146.194:33619)
0808 21:01:19.756618 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.756623 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.756632 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:19.756671 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.756674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.756700 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.756793 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:19.757067 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.757778 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.759051 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.759754 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.759845 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.759906 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.760049 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.760142 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":84,"threads_started":1}
I20260808 21:01:19.760675 18629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.756370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34113 (local address 127.0.0.1:44502)
0808 21:01:19.756545 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.756553 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.756598 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.756987 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.756988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.756990 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:19.757056 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.757060 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.758410 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.758412 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.759458 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.759461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.760475 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.760476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.760524 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.760527 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.760569 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.760596 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":4,"thread_start_us":87,"threads_started":1}
I20260808 21:01:19.760759 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.756629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44502 (local address 127.14.146.193:34113)
0808 21:01:19.756802 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.756807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.756819 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:01:19.756862 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.756864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.756879 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.757136 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:19.757194 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.758301 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.759552 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.760287 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.760377 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.760428 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.760604 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.760653 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
I20260808 21:01:19.760924 18630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.756160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:42531 (local address 127.0.0.1:41702)
0808 21:01:19.756334 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.756373 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.756445 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.756999 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.756999 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.757001 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:19.757056 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.757058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.758388 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.758390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.759357 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.759359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.760704 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.760705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.760776 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.760780 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.760814 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.760854 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":40,"thread_start_us":66,"threads_started":1}
I20260808 21:01:19.761162 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.756228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41702 (local address 127.14.146.195:42531)
0808 21:01:19.756838 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.756841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.756850 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:19.756884 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.756885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.756901 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.757136 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:19.757194 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.758297 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.759449 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.760200 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.761003 (+ 803us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.761046 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.761067 (+ 21us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.761096 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":133,"threads_started":1}
I20260808 21:01:19.761137 18250 tablet_service.cc:1467] Processing CreateTablet for tablet 672c507265e3408db27a4defa3597963 (DEFAULT_TABLE table=test-table [id=96e95a141f704a1d98fc372ed3f4451f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:19.761494 18250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 672c507265e3408db27a4defa3597963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:19.764488 18487 tablet_service.cc:1467] Processing CreateTablet for tablet 672c507265e3408db27a4defa3597963 (DEFAULT_TABLE table=test-table [id=96e95a141f704a1d98fc372ed3f4451f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:19.764709 18640 tablet_bootstrap.cc:492] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Bootstrap starting.
I20260808 21:01:19.764659 18017 tablet_service.cc:1467] Processing CreateTablet for tablet 672c507265e3408db27a4defa3597963 (DEFAULT_TABLE table=test-table [id=96e95a141f704a1d98fc372ed3f4451f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:19.764812 18487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 672c507265e3408db27a4defa3597963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:19.765013 18017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 672c507265e3408db27a4defa3597963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:19.765376 18640 tablet_bootstrap.cc:654] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:19.765726 18640 log.cc:824] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:19.766503 18640 tablet_bootstrap.cc:492] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: No bootstrap required, opened a new log
I20260808 21:01:19.766571 18640 ts_tablet_manager.cc:1397] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:19.767829 18643 tablet_bootstrap.cc:492] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: Bootstrap starting.
I20260808 21:01:19.768486 18644 tablet_bootstrap.cc:492] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: Bootstrap starting.
I20260808 21:01:19.768642 18640 raft_consensus.cc:348] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.768828 18640 raft_consensus.cc:374] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:19.768873 18640 raft_consensus.cc:729] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa470df762c4932b480b4c78fce4649, State: Initialized, Role: FOLLOWER
I20260808 21:01:19.768944 18643 tablet_bootstrap.cc:654] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:19.768991 18640 consensus_queue.cc:260] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.769134 18644 tablet_bootstrap.cc:654] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:19.769299 18640 ts_tablet_manager.cc:1428] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:01:19.769346 18352 heartbeater.cc:503] Master 127.14.146.254:35615 was elected leader, sending a full tablet report...
I20260808 21:01:19.769351 18643 log.cc:824] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:19.769510 18644 log.cc:824] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:19.770325 18643 tablet_bootstrap.cc:492] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: No bootstrap required, opened a new log
I20260808 21:01:19.770398 18643 ts_tablet_manager.cc:1397] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 21:01:19.771791 18643 raft_consensus.cc:348] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.771943 18643 raft_consensus.cc:374] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:19.771989 18643 raft_consensus.cc:729] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 960e6517ee974f6e93dd6f1fcefa933d, State: Initialized, Role: FOLLOWER
I20260808 21:01:19.772145 18643 consensus_queue.cc:260] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.772428 18643 ts_tablet_manager.cc:1428] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:19.772454 18601 heartbeater.cc:503] Master 127.14.146.254:35615 was elected leader, sending a full tablet report...
I20260808 21:01:19.772812 18644 tablet_bootstrap.cc:492] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: No bootstrap required, opened a new log
I20260808 21:01:19.772866 18644 ts_tablet_manager.cc:1397] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 21:01:19.774639 18644 raft_consensus.cc:348] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.774771 18644 raft_consensus.cc:374] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:19.774793 18644 raft_consensus.cc:729] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd52192f6f4f4595b82ea0115cb7f283, State: Initialized, Role: FOLLOWER
I20260808 21:01:19.774926 18644 consensus_queue.cc:260] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.775175 18644 ts_tablet_manager.cc:1428] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 21:01:19.775218 18134 heartbeater.cc:503] Master 127.14.146.254:35615 was elected leader, sending a full tablet report...
I20260808 21:01:19.791214 18653 raft_consensus.cc:482] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:19.791332 18653 raft_consensus.cc:504] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.791623 18653 leader_election.cc:288] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531), 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619)
I20260808 21:01:19.794788 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.791983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:50353 (local address 127.14.146.195:42531)
0808 21:01:19.792027 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.792029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.792039 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:19.792096 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.792097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.792108 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.792200 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:19.792390 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.792880 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.794057 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.794416 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.794511 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.794520 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.794685 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.794718 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:01:19.794800 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.791822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:42531 (local address 127.14.146.193:50353)
0808 21:01:19.791889 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.791902 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.791947 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.792233 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.792234 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.792237 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:19.792314 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.792316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.792966 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.792967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.793967 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.793970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.794513 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.794514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.794607 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.794610 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.794680 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.794718 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":31}
I20260808 21:01:19.794788 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.791912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:34423 (local address 127.14.146.194:33619)
0808 21:01:19.791976 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.791979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.792088 (+ 109us) server_negotiation.cc:407] Connection header received
0808 21:01:19.792171 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.792172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.792182 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.792249 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:19.792419 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.792884 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.794055 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.794420 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.794508 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.794517 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.794675 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.794711 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 21:01:19.794818 18655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.791822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:33619 (local address 127.14.146.193:34423)
0808 21:01:19.792019 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.792028 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.792112 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.792252 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.792253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.792255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:19.792338 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.792340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.792971 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.792972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.793961 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.793963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.794509 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.794510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.794581 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.794586 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.794667 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.794713 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":46,"thread_start_us":108,"threads_started":1}
I20260808 21:01:19.795135 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "672c507265e3408db27a4defa3597963" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa470df762c4932b480b4c78fce4649" is_pre_election: true
I20260808 21:01:19.795173 18519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "672c507265e3408db27a4defa3597963" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d" is_pre_election: true
I20260808 21:01:19.795300 18285 raft_consensus.cc:2454] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 0.
I20260808 21:01:19.795336 18519 raft_consensus.cc:2454] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 0.
I20260808 21:01:19.795557 17933 leader_election.cc:302] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, cd52192f6f4f4595b82ea0115cb7f283; no voters:
I20260808 21:01:19.795692 18653 raft_consensus.cc:2781] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:19.795768 18653 raft_consensus.cc:482] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:19.795801 18653 raft_consensus.cc:3037] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:19.796645 18653 raft_consensus.cc:504] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.796969 18519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "672c507265e3408db27a4defa3597963" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d"
I20260808 21:01:19.797048 18519 raft_consensus.cc:3037] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:19.797087 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "672c507265e3408db27a4defa3597963" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa470df762c4932b480b4c78fce4649"
I20260808 21:01:19.797181 18285 raft_consensus.cc:3037] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:19.797777 18519 raft_consensus.cc:2454] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 1.
I20260808 21:01:19.796911 18653 leader_election.cc:288] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 election: Requested vote from peers 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531), 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619)
I20260808 21:01:19.797958 18285 raft_consensus.cc:2454] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 1.
W20260808 21:01:19.798357 18355 tablet.cc:2369] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:19.798383 17935 leader_election.cc:302] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 960e6517ee974f6e93dd6f1fcefa933d, cd52192f6f4f4595b82ea0115cb7f283; no voters:
I20260808 21:01:19.798496 18653 raft_consensus.cc:2781] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:19.798652 18653 raft_consensus.cc:686] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 LEADER]: Becoming Leader. State: Replica: cd52192f6f4f4595b82ea0115cb7f283, State: Running, Role: LEADER
I20260808 21:01:19.798761 18653 consensus_queue.cc:237] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } }
I20260808 21:01:19.799669 17789 catalog_manager.cc:5495] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193). New cstate: current_term: 1 leader_uuid: "cd52192f6f4f4595b82ea0115cb7f283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } health_report { overall_health: HEALTHY } } }
Aug 08 21:01:19 dist-test-slave-t3q3 krb5kdc[17722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222879, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:19.836212 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.829012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35754 (local address 127.14.146.254:35615)
0808 21:01:19.829123 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.829125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.829192 (+ 67us) server_negotiation.cc:407] Connection header received
0808 21:01:19.829262 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.829263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.829275 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.829327 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:19.829797 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.830383 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.831115 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.831311 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.831369 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.833550 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:19.833551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:19.833551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:19.833558 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:19.835143 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.835525 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.835526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.835526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.835585 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:19.835762 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:19.835762 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:19.835763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:19.835866 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:19.835918 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.836080 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.836144 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 21:01:19.836293 18672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.828905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:35615 (local address 127.0.0.1:35754)
0808 21:01:19.829092 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.829106 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.829186 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.829344 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.829345 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.829666 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:19.829718 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.829721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.830467 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.830468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.831003 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.831004 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.831384 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.831384 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.831431 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.831971 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:19.831975 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:19.833439 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:19.835225 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.835233 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.835235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.835444 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.835649 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:19.835649 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:19.835649 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:19.835707 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:19.835928 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:19.835935 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:19.835979 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.836036 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.836199 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":3,"thread_start_us":116,"threads_started":1}
I20260808 21:01:19.838474 17789 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:35754:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 21:01:19.838666 17789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:19.840163 18250 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6f82bf06db4f9a9abae97798a0f0f8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=87534b930130495ba2917c534a756f71]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:19.840148 18017 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6f82bf06db4f9a9abae97798a0f0f8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=87534b930130495ba2917c534a756f71]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:19.840214 18487 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6f82bf06db4f9a9abae97798a0f0f8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=87534b930130495ba2917c534a756f71]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:19.840356 18487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6f82bf06db4f9a9abae97798a0f0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:19.840358 18017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6f82bf06db4f9a9abae97798a0f0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:19.840355 18250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6f82bf06db4f9a9abae97798a0f0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:19.841573 18640 tablet_bootstrap.cc:492] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: Bootstrap starting.
I20260808 21:01:19.841883 18643 tablet_bootstrap.cc:492] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: Bootstrap starting.
I20260808 21:01:19.842456 18640 tablet_bootstrap.cc:654] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:19.842456 18643 tablet_bootstrap.cc:654] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:19.842882 18644 tablet_bootstrap.cc:492] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: Bootstrap starting.
I20260808 21:01:19.843271 18643 tablet_bootstrap.cc:492] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: No bootstrap required, opened a new log
I20260808 21:01:19.843333 18643 ts_tablet_manager.cc:1397] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:19.843359 18644 tablet_bootstrap.cc:654] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:19.843495 18643 raft_consensus.cc:348] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.843590 18643 raft_consensus.cc:374] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:19.843616 18643 raft_consensus.cc:729] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 960e6517ee974f6e93dd6f1fcefa933d, State: Initialized, Role: FOLLOWER
I20260808 21:01:19.843686 18643 consensus_queue.cc:260] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.843803 18643 ts_tablet_manager.cc:1428] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.843892 18652 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:19.844002 18652 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:19.844024 18640 tablet_bootstrap.cc:492] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: No bootstrap required, opened a new log
I20260808 21:01:19.844044 18644 tablet_bootstrap.cc:492] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: No bootstrap required, opened a new log
I20260808 21:01:19.844094 18640 ts_tablet_manager.cc:1397] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 21:01:19.844108 18644 ts_tablet_manager.cc:1397] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:19.844259 18640 raft_consensus.cc:348] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.844261 18644 raft_consensus.cc:348] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.844334 18644 raft_consensus.cc:374] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:19.844334 18640 raft_consensus.cc:374] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:19.844357 18640 raft_consensus.cc:729] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa470df762c4932b480b4c78fce4649, State: Initialized, Role: FOLLOWER
I20260808 21:01:19.844357 18644 raft_consensus.cc:729] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd52192f6f4f4595b82ea0115cb7f283, State: Initialized, Role: FOLLOWER
I20260808 21:01:19.844401 18640 consensus_queue.cc:260] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.844401 18644 consensus_queue.cc:260] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.844485 18640 ts_tablet_manager.cc:1428] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.844487 18644 ts_tablet_manager.cc:1428] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:19.844578 18645 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:19.844605 18653 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:19.844677 18645 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:19.844699 18653 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 21:01:19.885862 18135 tablet.cc:2369] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:19.962072 18645 raft_consensus.cc:482] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:19.962183 18645 raft_consensus.cc:504] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.962514 18645 leader_election.cc:288] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113), 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:19.965487 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.962800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:49451 (local address 127.14.146.193:34113)
0808 21:01:19.962865 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.962868 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.962879 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:19.962916 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.962918 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.962929 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.963030 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:19.963224 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.963708 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.964750 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.965109 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.965201 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.965211 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.965387 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.965429 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:01:19.965487 18184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.962720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34113 (local address 127.14.146.194:49451)
0808 21:01:19.962779 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.962792 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.962842 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.963036 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.963038 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.963040 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:19.963121 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.963123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.963794 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.963796 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.964634 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.964637 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.965203 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.965204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.965303 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.965306 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.965368 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.965406 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":2}
I20260808 21:01:19.965627 18677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.962848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:42531 (local address 127.14.146.194:56747)
0808 21:01:19.963060 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.963069 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.963170 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.963306 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.963306 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.963308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:19.963389 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.963391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.964041 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.964043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.964803 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.964806 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.965353 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.965354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.965428 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.965431 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.965495 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.965536 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":29,"thread_start_us":137,"threads_started":1}
I20260808 21:01:19.965612 18631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.962968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:56747 (local address 127.14.146.195:42531)
0808 21:01:19.963028 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.963030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.963156 (+ 126us) server_negotiation.cc:407] Connection header received
0808 21:01:19.963226 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.963227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.963236 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.963290 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:19.963463 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.963940 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.964897 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.965251 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.965337 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.965347 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.965514 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.965549 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 21:01:19.965898 18049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6f82bf06db4f9a9abae97798a0f0f8" candidate_uuid: "8fa470df762c4932b480b4c78fce4649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd52192f6f4f4595b82ea0115cb7f283" is_pre_election: true
I20260808 21:01:19.965937 18519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6f82bf06db4f9a9abae97798a0f0f8" candidate_uuid: "8fa470df762c4932b480b4c78fce4649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d" is_pre_election: true
I20260808 21:01:19.966032 18519 raft_consensus.cc:2454] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa470df762c4932b480b4c78fce4649 in term 0.
I20260808 21:01:19.966053 18049 raft_consensus.cc:2454] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa470df762c4932b480b4c78fce4649 in term 0.
I20260808 21:01:19.966231 18178 leader_election.cc:302] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, 960e6517ee974f6e93dd6f1fcefa933d; no voters:
I20260808 21:01:19.966364 18645 raft_consensus.cc:2781] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:19.966416 18645 raft_consensus.cc:482] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:19.966439 18645 raft_consensus.cc:3037] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:19.967144 18645 raft_consensus.cc:504] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.967289 18645 leader_election.cc:288] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [CANDIDATE]: Term 1 election: Requested vote from peers cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113), 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:19.967483 18049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6f82bf06db4f9a9abae97798a0f0f8" candidate_uuid: "8fa470df762c4932b480b4c78fce4649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd52192f6f4f4595b82ea0115cb7f283"
I20260808 21:01:19.967471 18519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6f82bf06db4f9a9abae97798a0f0f8" candidate_uuid: "8fa470df762c4932b480b4c78fce4649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d"
I20260808 21:01:19.967555 18519 raft_consensus.cc:3037] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:19.967555 18049 raft_consensus.cc:3037] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Advancing to term 1
W20260808 21:01:19.967703 18602 tablet.cc:2369] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:19.968389 18049 raft_consensus.cc:2454] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa470df762c4932b480b4c78fce4649 in term 1.
I20260808 21:01:19.968389 18519 raft_consensus.cc:2454] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa470df762c4932b480b4c78fce4649 in term 1.
I20260808 21:01:19.968560 18178 leader_election.cc:302] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, 960e6517ee974f6e93dd6f1fcefa933d; no voters:
I20260808 21:01:19.968667 18645 raft_consensus.cc:2781] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:19.968829 18645 raft_consensus.cc:686] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa470df762c4932b480b4c78fce4649, State: Running, Role: LEADER
I20260808 21:01:19.968942 18645 consensus_queue.cc:237] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:19.969448 18678 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: TxnStatusTablet state changed. Reason: New leader 8fa470df762c4932b480b4c78fce4649. Latest consensus state: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:19.969538 18678 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:19.969807 18680 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 21:01:19.970016 18680 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 21:01:19.969907 17792 catalog_manager.cc:5495] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa470df762c4932b480b4c78fce4649 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:19.989810 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.987158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40924 (local address 127.14.146.194:33619)
0808 21:01:19.987212 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.987215 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.987225 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:19.987351 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.987352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.987372 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.987435 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:19.987582 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.988154 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.988917 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.989137 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.989220 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.989417 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:19.989530 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:19.989626 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:19.989689 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 21:01:19.989712 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 21:01:19.989810 18672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.987084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:33619 (local address 127.0.0.1:40924)
0808 21:01:19.987163 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:19.987177 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:19.987233 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:19.987445 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:19.987446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:19.987447 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:19.987503 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.987510 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.988242 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.988243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.988827 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:19.988829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.989232 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.989233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:19.989305 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.989321 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:19.989626 (+ 305us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:19.989637 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 21:01:19.989687 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 21:01:19.989736 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 21:01:19.991897 18519 raft_consensus.cc:1261] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Refusing update from remote peer 8fa470df762c4932b480b4c78fce4649: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:19.991919 18049 raft_consensus.cc:1261] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Refusing update from remote peer 8fa470df762c4932b480b4c78fce4649: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:19.992287 18678 consensus_queue.cc:1035] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [LEADER]: Connected to new peer: Peer: permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:19.992424 18645 consensus_queue.cc:1035] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:19.993584 18653 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: TxnStatusTablet state changed. Reason: New leader 8fa470df762c4932b480b4c78fce4649. Latest consensus state: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:19.993700 18653 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:19.993767 18652 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: TxnStatusTablet state changed. Reason: New leader 8fa470df762c4932b480b4c78fce4649. Latest consensus state: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:19.993878 18652 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:19.994769 18678 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:19.994869 18678 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:19.995201 18686 mvcc.cc:205] Tried to move back new op lower bound from 7316368916444172288 to 7316368916353597440. Current Snapshot: MvccSnapshot[applied={T|T < 7316368916444172288}]
I20260808 21:01:19.995296 18689 mvcc.cc:205] Tried to move back new op lower bound from 7316368916444172288 to 7316368916353597440. Current Snapshot: MvccSnapshot[applied={T|T < 7316368916444172288}]
I20260808 21:01:19.995869 18652 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:19.995970 18652 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 960e6517ee974f6e93dd6f1fcefa933d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:20.000352 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:19.997633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44518 (local address 127.14.146.193:34113)
0808 21:01:19.997671 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:19.997673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:19.997699 (+ 26us) server_negotiation.cc:407] Connection header received
0808 21:01:19.997773 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:19.997774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:19.997793 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:19.997873 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:19.997956 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.998725 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.999473 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:19.999780 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:19.999854 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:19.999978 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:20.000123 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:20.000210 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:20.000253 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 21:01:20.000276 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:01:20.000662 18645 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:20.000748 18645 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P 8fa470df762c4932b480b4c78fce4649: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:20.001147 18653 tablet_replica.cc:439] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } } }
I20260808 21:01:20.001236 18653 tablet_replica.cc:442] T 1c6f82bf06db4f9a9abae97798a0f0f8 P cd52192f6f4f4595b82ea0115cb7f283: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:20.005864 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:20.003071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:40503 (local address 127.14.146.194:33619)
0808 21:01:20.003145 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:20.003149 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:20.003211 (+ 62us) server_negotiation.cc:407] Connection header received
0808 21:01:20.003285 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:20.003285 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:20.003293 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:20.003333 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:20.003459 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.003910 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.005062 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.005284 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.005402 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:20.005630 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:20.005672 (+ 42us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:20.005718 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:20.005797 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 21:01:20.005815 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 21:01:20.005925 18707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:20.002985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:33619 (local address 127.14.146.193:40503)
0808 21:01:20.003147 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:20.003158 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:20.003227 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:20.003346 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:20.003346 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:20.003348 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:20.003405 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:20.003406 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.003963 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.003964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:20.004932 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:20.004936 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.005406 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.005407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:20.005477 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:20.005493 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:20.005738 (+ 245us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:20.005740 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:20.005794 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 21:01:20.005836 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
I20260808 21:01:20.008358 18285 raft_consensus.cc:1261] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Refusing update from remote peer cd52192f6f4f4595b82ea0115cb7f283: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:20.008605 18519 raft_consensus.cc:1261] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Refusing update from remote peer cd52192f6f4f4595b82ea0115cb7f283: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:20.008633 18653 consensus_queue.cc:1035] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:20.008800 18656 consensus_queue.cc:1035] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:20.018129 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:20.015061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34113 (local address 127.14.146.194:38751)
0808 21:01:20.015150 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:20.015161 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:20.015214 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:20.015332 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:20.015333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:20.015334 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:20.015392 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:20.015393 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.016284 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.016285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:20.017185 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:20.017188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.017680 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.017681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:20.017756 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:20.017772 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:20.017974 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:20.017977 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:20.018037 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 21:01:20.018077 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 21:01:20.018138 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:20.015124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:38751 (local address 127.14.146.193:34113)
0808 21:01:20.015160 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:20.015162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:20.015206 (+ 44us) server_negotiation.cc:407] Connection header received
0808 21:01:20.015256 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:20.015256 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:20.015266 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:20.015331 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:20.015445 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.016206 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.017266 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.017567 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.017638 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:20.017866 (+ 228us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:20.017900 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:20.017952 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:20.018044 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 21:01:20.018066 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:01:20.027690 17789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:20.027813 17789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:20.028628 17789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: Sending DeleteTablet for 3 replicas of tablet 672c507265e3408db27a4defa3597963
I20260808 21:01:20.029031 18487 tablet_service.cc:1514] Processing DeleteTablet for tablet 672c507265e3408db27a4defa3597963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:20 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:41702
I20260808 21:01:20.029045 18017 tablet_service.cc:1514] Processing DeleteTablet for tablet 672c507265e3408db27a4defa3597963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:20 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:44502
I20260808 21:01:20.029325 18250 tablet_service.cc:1514] Processing DeleteTablet for tablet 672c507265e3408db27a4defa3597963 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:20 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:40918
I20260808 21:01:20.029448 18722 tablet_replica.cc:330] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: stopping tablet replica
I20260808 21:01:20.029603 18722 raft_consensus.cc:2229] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:20.029762 18722 raft_consensus.cc:2258] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:20.029793 17789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:20.029946 17789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:20.030534 18722 ts_tablet_manager.cc:1905] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:20.031337 18017 tablet_service.cc:1467] Processing CreateTablet for tablet ee188ef10c4b4fa8bc57a6fb5e772996 (DEFAULT_TABLE table=test-table [id=b2613e18287b4897822cb6c7259a4727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:20.031462 18017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee188ef10c4b4fa8bc57a6fb5e772996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:20.032774 18644 tablet_bootstrap.cc:492] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: Bootstrap starting.
I20260808 21:01:20.033219 18644 tablet_bootstrap.cc:654] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:20.033376 18722 ts_tablet_manager.cc:1918] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:20.033504 18722 log.cc:1196] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/672c507265e3408db27a4defa3597963
I20260808 21:01:20.033685 18250 tablet_service.cc:1467] Processing CreateTablet for tablet ee188ef10c4b4fa8bc57a6fb5e772996 (DEFAULT_TABLE table=test-table [id=b2613e18287b4897822cb6c7259a4727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:20.033812 18250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee188ef10c4b4fa8bc57a6fb5e772996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:20.034008 18722 ts_tablet_manager.cc:1939] T 672c507265e3408db27a4defa3597963 P cd52192f6f4f4595b82ea0115cb7f283: Deleting consensus metadata
I20260808 21:01:20.034466 17772 catalog_manager.cc:4841] TS cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113): tablet 672c507265e3408db27a4defa3597963 (table test-table [id=96e95a141f704a1d98fc372ed3f4451f]) successfully deleted
I20260808 21:01:20.035108 18640 tablet_bootstrap.cc:492] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: Bootstrap starting.
I20260808 21:01:20.035326 18487 tablet_service.cc:1467] Processing CreateTablet for tablet ee188ef10c4b4fa8bc57a6fb5e772996 (DEFAULT_TABLE table=test-table [id=b2613e18287b4897822cb6c7259a4727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:20.035444 18487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee188ef10c4b4fa8bc57a6fb5e772996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:20.035561 18640 tablet_bootstrap.cc:654] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:20.036460 18640 tablet_bootstrap.cc:492] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: No bootstrap required, opened a new log
I20260808 21:01:20.036511 18640 ts_tablet_manager.cc:1397] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:20.036680 18640 raft_consensus.cc:348] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.036751 18640 raft_consensus.cc:374] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:20.036772 18640 raft_consensus.cc:729] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa470df762c4932b480b4c78fce4649, State: Initialized, Role: FOLLOWER
I20260808 21:01:20.036783 18643 tablet_bootstrap.cc:492] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: Bootstrap starting.
I20260808 21:01:20.036821 18640 consensus_queue.cc:260] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.036938 18640 ts_tablet_manager.cc:1428] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:20.037156 18643 tablet_bootstrap.cc:654] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:20.037921 18643 tablet_bootstrap.cc:492] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: No bootstrap required, opened a new log
I20260808 21:01:20.037974 18643 ts_tablet_manager.cc:1397] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:20.038111 18643 raft_consensus.cc:348] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.038182 18643 raft_consensus.cc:374] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:20.038213 18643 raft_consensus.cc:729] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 960e6517ee974f6e93dd6f1fcefa933d, State: Initialized, Role: FOLLOWER
I20260808 21:01:20.038259 18643 consensus_queue.cc:260] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.038341 18643 ts_tablet_manager.cc:1428] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:20.039562 18644 tablet_bootstrap.cc:492] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: No bootstrap required, opened a new log
I20260808 21:01:20.039619 18644 ts_tablet_manager.cc:1397] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260808 21:01:20.039767 18644 raft_consensus.cc:348] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.039840 18644 raft_consensus.cc:374] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:20.039861 18644 raft_consensus.cc:729] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd52192f6f4f4595b82ea0115cb7f283, State: Initialized, Role: FOLLOWER
I20260808 21:01:20.039901 18644 consensus_queue.cc:260] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.039990 18644 ts_tablet_manager.cc:1428] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:20.040671 18723 tablet_replica.cc:330] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: stopping tablet replica
I20260808 21:01:20.040865 18723 raft_consensus.cc:2229] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:20.040930 18723 raft_consensus.cc:2258] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:20.040172 18721 tablet_replica.cc:330] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: stopping tablet replica
I20260808 21:01:20.041111 18721 raft_consensus.cc:2229] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:20.041173 18721 raft_consensus.cc:2258] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:20.041478 18723 ts_tablet_manager.cc:1905] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:20.041603 18721 ts_tablet_manager.cc:1905] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:20.043344 18723 ts_tablet_manager.cc:1918] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:20.043406 18721 ts_tablet_manager.cc:1918] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:20.043485 18721 log.cc:1196] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/672c507265e3408db27a4defa3597963
I20260808 21:01:20.043570 18723 log.cc:1196] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/672c507265e3408db27a4defa3597963
I20260808 21:01:20.043747 18721 ts_tablet_manager.cc:1939] T 672c507265e3408db27a4defa3597963 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting consensus metadata
I20260808 21:01:20.043963 18723 ts_tablet_manager.cc:1939] T 672c507265e3408db27a4defa3597963 P 8fa470df762c4932b480b4c78fce4649: Deleting consensus metadata
I20260808 21:01:20.044178 17772 catalog_manager.cc:4841] TS 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531): tablet 672c507265e3408db27a4defa3597963 (table test-table [id=96e95a141f704a1d98fc372ed3f4451f]) successfully deleted
I20260808 21:01:20.044517 17771 catalog_manager.cc:4841] TS 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619): tablet 672c507265e3408db27a4defa3597963 (table test-table [id=96e95a141f704a1d98fc372ed3f4451f]) successfully deleted
I20260808 21:01:20.193966 18709 raft_consensus.cc:482] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:20.194067 18709 raft_consensus.cc:504] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.194231 18709 leader_election.cc:288] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113), 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:20.194509 18519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee188ef10c4b4fa8bc57a6fb5e772996" candidate_uuid: "8fa470df762c4932b480b4c78fce4649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d" is_pre_election: true
I20260808 21:01:20.194490 18049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee188ef10c4b4fa8bc57a6fb5e772996" candidate_uuid: "8fa470df762c4932b480b4c78fce4649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd52192f6f4f4595b82ea0115cb7f283" is_pre_election: true
I20260808 21:01:20.194597 18049 raft_consensus.cc:2454] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa470df762c4932b480b4c78fce4649 in term 0.
I20260808 21:01:20.194597 18519 raft_consensus.cc:2454] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa470df762c4932b480b4c78fce4649 in term 0.
I20260808 21:01:20.194767 18178 leader_election.cc:302] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, 960e6517ee974f6e93dd6f1fcefa933d; no voters:
I20260808 21:01:20.194867 18709 raft_consensus.cc:2781] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:20.194909 18709 raft_consensus.cc:482] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:20.194929 18709 raft_consensus.cc:3037] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:20.195771 18709 raft_consensus.cc:504] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.195900 18709 leader_election.cc:288] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [CANDIDATE]: Term 1 election: Requested vote from peers cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113), 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:20.196096 18519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee188ef10c4b4fa8bc57a6fb5e772996" candidate_uuid: "8fa470df762c4932b480b4c78fce4649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d"
I20260808 21:01:20.196171 18519 raft_consensus.cc:3037] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:20.196092 18049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee188ef10c4b4fa8bc57a6fb5e772996" candidate_uuid: "8fa470df762c4932b480b4c78fce4649" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd52192f6f4f4595b82ea0115cb7f283"
I20260808 21:01:20.196242 18049 raft_consensus.cc:3037] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:20.196918 18519 raft_consensus.cc:2454] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa470df762c4932b480b4c78fce4649 in term 1.
I20260808 21:01:20.197104 18178 leader_election.cc:302] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, 960e6517ee974f6e93dd6f1fcefa933d; no voters:
I20260808 21:01:20.197178 18049 raft_consensus.cc:2454] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa470df762c4932b480b4c78fce4649 in term 1.
I20260808 21:01:20.197211 18709 raft_consensus.cc:2781] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:20.197259 18709 raft_consensus.cc:686] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa470df762c4932b480b4c78fce4649, State: Running, Role: LEADER
I20260808 21:01:20.197321 18709 consensus_queue.cc:237] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:20.197938 17789 catalog_manager.cc:5495] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa470df762c4932b480b4c78fce4649 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "8fa470df762c4932b480b4c78fce4649" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:20.226065 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:20.223721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40936 (local address 127.14.146.194:33619)
0808 21:01:20.223798 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:20.223799 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:20.223809 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:20.223863 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:20.223864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:20.223877 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:20.223923 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:20.224083 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.224586 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.225333 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.225554 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.225634 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:20.225786 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:20.225823 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:20.225891 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:20.225956 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 21:01:20.225977 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 21:01:20.230420 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:20.228291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:53847 (local address 127.14.146.194:33619)
0808 21:01:20.228343 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:20.228345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:20.228353 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:20.228435 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:20.228436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:20.228445 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:20.228497 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:20.228614 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.229055 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.229759 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.229942 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.230024 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:20.230163 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:20.230202 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:20.230263 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:20.230322 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 21:01:20.230339 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":35}
I20260808 21:01:20.230420 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:20.228227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:33619 (local address 127.14.146.194:53847)
0808 21:01:20.228284 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:20.228302 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:20.228362 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:20.228500 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:20.228500 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:20.228501 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:20.228543 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:20.228544 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.229133 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.229135 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:20.229656 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:20.229658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:20.230023 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:20.230024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:20.230080 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:20.230083 (+ 3us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:20.230263 (+ 180us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:20.230265 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:20.230318 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 21:01:20.230360 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":3}
I20260808 21:01:20.232651 18519 raft_consensus.cc:1261] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Refusing update from remote peer 8fa470df762c4932b480b4c78fce4649: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:20.232694 18049 raft_consensus.cc:1261] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Refusing update from remote peer 8fa470df762c4932b480b4c78fce4649: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:20.232899 18645 consensus_queue.cc:1035] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:20.233011 18709 consensus_queue.cc:1035] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [LEADER]: Connected to new peer: Peer: permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 21:01:20.237629 18686 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 21:01:21.755401 17789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:21.755551 17789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:21.756390 17789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: Sending DeleteTablet for 3 replicas of tablet ee188ef10c4b4fa8bc57a6fb5e772996
I20260808 21:01:21.756641 18247 tablet_service.cc:1514] Processing DeleteTablet for tablet ee188ef10c4b4fa8bc57a6fb5e772996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:21 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:40918
I20260808 21:01:21.756672 18487 tablet_service.cc:1514] Processing DeleteTablet for tablet ee188ef10c4b4fa8bc57a6fb5e772996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:21 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:41702
I20260808 21:01:21.756716 18017 tablet_service.cc:1514] Processing DeleteTablet for tablet ee188ef10c4b4fa8bc57a6fb5e772996 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:21 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:44502
I20260808 21:01:21.758728 18767 tablet_replica.cc:330] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: stopping tablet replica
I20260808 21:01:21.758807 18767 raft_consensus.cc:2229] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:21.758854 18767 raft_consensus.cc:2258] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:21.758961 18766 tablet_replica.cc:330] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: stopping tablet replica
I20260808 21:01:21.759024 18766 raft_consensus.cc:2229] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:21.759111 18766 raft_consensus.cc:2258] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:21.759280 18767 ts_tablet_manager.cc:1905] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:21.759356 18766 ts_tablet_manager.cc:1905] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:21.761022 18765 tablet_replica.cc:330] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: stopping tablet replica
I20260808 21:01:21.761097 18765 raft_consensus.cc:2229] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:21.761106 18766 ts_tablet_manager.cc:1918] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 21:01:21.761142 18765 raft_consensus.cc:2258] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:21.761173 18766 log.cc:1196] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/ee188ef10c4b4fa8bc57a6fb5e772996
I20260808 21:01:21.761416 18766 ts_tablet_manager.cc:1939] T ee188ef10c4b4fa8bc57a6fb5e772996 P 8fa470df762c4932b480b4c78fce4649: Deleting consensus metadata
I20260808 21:01:21.761402 18765 ts_tablet_manager.cc:1905] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:21.761801 17771 catalog_manager.cc:4841] TS 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619): tablet ee188ef10c4b4fa8bc57a6fb5e772996 (table test-table [id=b2613e18287b4897822cb6c7259a4727]) successfully deleted
I20260808 21:01:21.763244 18767 ts_tablet_manager.cc:1918] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 21:01:21.763319 18767 log.cc:1196] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/ee188ef10c4b4fa8bc57a6fb5e772996
I20260808 21:01:21.763310 18765 ts_tablet_manager.cc:1918] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 21:01:21.763361 18765 log.cc:1196] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/ee188ef10c4b4fa8bc57a6fb5e772996
I20260808 21:01:21.763557 18767 ts_tablet_manager.cc:1939] T ee188ef10c4b4fa8bc57a6fb5e772996 P cd52192f6f4f4595b82ea0115cb7f283: Deleting consensus metadata
I20260808 21:01:21.763583 18765 ts_tablet_manager.cc:1939] T ee188ef10c4b4fa8bc57a6fb5e772996 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting consensus metadata
I20260808 21:01:21.763876 17772 catalog_manager.cc:4841] TS 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531): tablet ee188ef10c4b4fa8bc57a6fb5e772996 (table test-table [id=b2613e18287b4897822cb6c7259a4727]) successfully deleted
I20260808 21:01:21.763968 17772 catalog_manager.cc:4841] TS cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113): tablet ee188ef10c4b4fa8bc57a6fb5e772996 (table test-table [id=b2613e18287b4897822cb6c7259a4727]) successfully deleted
Aug 08 21:01:21 dist-test-slave-t3q3 krb5kdc[17722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222881, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 21:01:21 dist-test-slave-t3q3 krb5kdc[17722](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222881, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:21.784603 18783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:21.777065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35762 (local address 127.14.146.254:35615)
0808 21:01:21.777230 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:21.777237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:21.777247 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:21.777274 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:21.777274 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:21.777285 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:21.777347 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:21.777939 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:21.778449 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:21.779185 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:21.779379 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:21.779430 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:21.781731 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:21.781732 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:21.781732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:21.781739 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:21.783348 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:21.783662 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:21.783663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:21.783663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:21.783777 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:21.783962 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:21.783963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:21.783963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:21.784120 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:21.784211 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:21.784414 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 21:01:21.784488 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260808 21:01:21.786093 17789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:21.786252 17789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:21.787725 18017 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd (DEFAULT_TABLE table=test-table [id=a9d50530603b4addb1a3a9daea90546a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:21.787735 18247 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd (DEFAULT_TABLE table=test-table [id=a9d50530603b4addb1a3a9daea90546a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:21.787742 18487 tablet_service.cc:1467] Processing CreateTablet for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd (DEFAULT_TABLE table=test-table [id=a9d50530603b4addb1a3a9daea90546a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:21.787879 18017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:21.787896 18487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:21.787876 18247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:21.789168 18784 tablet_bootstrap.cc:492] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: Bootstrap starting.
I20260808 21:01:21.789415 18786 tablet_bootstrap.cc:492] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: Bootstrap starting.
I20260808 21:01:21.789515 18785 tablet_bootstrap.cc:492] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: Bootstrap starting.
I20260808 21:01:21.789613 18784 tablet_bootstrap.cc:654] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:21.789891 18785 tablet_bootstrap.cc:654] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:21.789928 18786 tablet_bootstrap.cc:654] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:21.790285 18784 tablet_bootstrap.cc:492] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: No bootstrap required, opened a new log
I20260808 21:01:21.790355 18784 ts_tablet_manager.cc:1397] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:21.790503 18785 tablet_bootstrap.cc:492] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: No bootstrap required, opened a new log
I20260808 21:01:21.790485 18784 raft_consensus.cc:348] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.790545 18785 ts_tablet_manager.cc:1397] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:21.790581 18784 raft_consensus.cc:374] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:21.790617 18784 raft_consensus.cc:729] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 960e6517ee974f6e93dd6f1fcefa933d, State: Initialized, Role: FOLLOWER
I20260808 21:01:21.790683 18784 consensus_queue.cc:260] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.790668 18785 raft_consensus.cc:348] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.790740 18785 raft_consensus.cc:374] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:21.790773 18785 raft_consensus.cc:729] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd52192f6f4f4595b82ea0115cb7f283, State: Initialized, Role: FOLLOWER
I20260808 21:01:21.790824 18785 consensus_queue.cc:260] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.790871 18784 ts_tablet_manager.cc:1428] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:21.790994 18785 ts_tablet_manager.cc:1428] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:21.791625 18786 tablet_bootstrap.cc:492] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: No bootstrap required, opened a new log
I20260808 21:01:21.791679 18786 ts_tablet_manager.cc:1397] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:21.791803 18786 raft_consensus.cc:348] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.791885 18786 raft_consensus.cc:374] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:21.791916 18786 raft_consensus.cc:729] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa470df762c4932b480b4c78fce4649, State: Initialized, Role: FOLLOWER
I20260808 21:01:21.791963 18786 consensus_queue.cc:260] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.792132 18786 ts_tablet_manager.cc:1428] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:21.826110 18800 raft_consensus.cc:482] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:21.826239 18800 raft_consensus.cc:504] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.826448 18800 leader_election.cc:288] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619), 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:21.826685 18519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0923e8c0a84fd9bfaa75ce7f6e04dd" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d" is_pre_election: true
I20260808 21:01:21.826694 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0923e8c0a84fd9bfaa75ce7f6e04dd" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa470df762c4932b480b4c78fce4649" is_pre_election: true
I20260808 21:01:21.826797 18519 raft_consensus.cc:2454] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 0.
I20260808 21:01:21.826803 18285 raft_consensus.cc:2454] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 0.
I20260808 21:01:21.826992 17933 leader_election.cc:302] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, 960e6517ee974f6e93dd6f1fcefa933d, cd52192f6f4f4595b82ea0115cb7f283; no voters:
I20260808 21:01:21.827113 18800 raft_consensus.cc:2781] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:21.827157 18800 raft_consensus.cc:482] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:21.827180 18800 raft_consensus.cc:3037] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:21.827862 18800 raft_consensus.cc:504] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.828001 18800 leader_election.cc:288] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619), 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:21.828166 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0923e8c0a84fd9bfaa75ce7f6e04dd" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa470df762c4932b480b4c78fce4649"
I20260808 21:01:21.828248 18285 raft_consensus.cc:3037] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:21.828186 18519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d0923e8c0a84fd9bfaa75ce7f6e04dd" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d"
I20260808 21:01:21.828312 18519 raft_consensus.cc:3037] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:21.828877 18285 raft_consensus.cc:2454] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 1.
I20260808 21:01:21.828962 18519 raft_consensus.cc:2454] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 1.
I20260808 21:01:21.829059 17933 leader_election.cc:302] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, cd52192f6f4f4595b82ea0115cb7f283; no voters:
I20260808 21:01:21.829155 18800 raft_consensus.cc:2781] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:21.829294 18800 raft_consensus.cc:686] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 1 LEADER]: Becoming Leader. State: Replica: cd52192f6f4f4595b82ea0115cb7f283, State: Running, Role: LEADER
I20260808 21:01:21.829365 18800 consensus_queue.cc:237] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.830013 17792 catalog_manager.cc:5495] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193). New cstate: current_term: 1 leader_uuid: "cd52192f6f4f4595b82ea0115cb7f283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:21.838845 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:21.836704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44532 (local address 127.14.146.193:34113)
0808 21:01:21.836845 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:21.836847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:21.836854 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:01:21.836889 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:21.836890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:21.836901 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:21.836959 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:21.837096 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:21.837574 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:21.838287 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:21.838473 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:21.838524 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:21.838641 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:21.838665 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:21.838700 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:21.838747 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 21:01:21.838761 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":98,"threads_started":1}
I20260808 21:01:21.841044 18285 raft_consensus.cc:1261] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Refusing update from remote peer cd52192f6f4f4595b82ea0115cb7f283: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:21.841073 18519 raft_consensus.cc:1261] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Refusing update from remote peer cd52192f6f4f4595b82ea0115cb7f283: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:21.841320 18803 consensus_queue.cc:1035] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:21.841418 18800 consensus_queue.cc:1035] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:21.842422 18745 mvcc.cc:205] Tried to move back new op lower bound from 7316368924019589120 to 7316368923973537792. Current Snapshot: MvccSnapshot[applied={T|T < 7316368924019589120}]
I20260808 21:01:21.851436 17792 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:21.851570 17792 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:21.852181 17792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: Sending DeleteTablet for 3 replicas of tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd
I20260808 21:01:21.852453 18017 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:21 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:44502
I20260808 21:01:21.852454 18487 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:21 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:41702
I20260808 21:01:21.852572 18767 tablet_replica.cc:330] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: stopping tablet replica
I20260808 21:01:21.852603 18765 tablet_replica.cc:330] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: stopping tablet replica
I20260808 21:01:21.852625 18767 raft_consensus.cc:2229] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:21.852669 18765 raft_consensus.cc:2229] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:21.852684 18767 raft_consensus.cc:2258] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:21.852718 18765 raft_consensus.cc:2258] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:21.852728 18247 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:21 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:40918
I20260808 21:01:21.852820 18766 tablet_replica.cc:330] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: stopping tablet replica
I20260808 21:01:21.852877 18766 raft_consensus.cc:2229] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:21.852907 18766 raft_consensus.cc:2258] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:21.853008 18767 ts_tablet_manager.cc:1905] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:21.853240 18766 ts_tablet_manager.cc:1905] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:21.854439 18767 ts_tablet_manager.cc:1918] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:21.854468 18766 ts_tablet_manager.cc:1918] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:21.854421 17792 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 21:01:21.854518 18766 log.cc:1196] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/3d0923e8c0a84fd9bfaa75ce7f6e04dd
I20260808 21:01:21.854523 18767 log.cc:1196] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/3d0923e8c0a84fd9bfaa75ce7f6e04dd
W20260808 21:01:21.854580 17792 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:21.854771 18766 ts_tablet_manager.cc:1939] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 8fa470df762c4932b480b4c78fce4649: Deleting consensus metadata
I20260808 21:01:21.854790 18767 ts_tablet_manager.cc:1939] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P cd52192f6f4f4595b82ea0115cb7f283: Deleting consensus metadata
I20260808 21:01:21.854869 18765 ts_tablet_manager.cc:1905] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:21.855121 17772 catalog_manager.cc:4841] TS cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113): tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd (table test-table [id=a9d50530603b4addb1a3a9daea90546a]) successfully deleted
I20260808 21:01:21.856043 17771 catalog_manager.cc:4841] TS 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619): tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd (table test-table [id=a9d50530603b4addb1a3a9daea90546a]) successfully deleted
I20260808 21:01:21.856231 18765 ts_tablet_manager.cc:1918] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:21.856319 18765 log.cc:1196] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/3d0923e8c0a84fd9bfaa75ce7f6e04dd
I20260808 21:01:21.856587 18765 ts_tablet_manager.cc:1939] T 3d0923e8c0a84fd9bfaa75ce7f6e04dd P 960e6517ee974f6e93dd6f1fcefa933d: Deleting consensus metadata
I20260808 21:01:21.856904 18247 tablet_service.cc:1467] Processing CreateTablet for tablet c73054c4f23b4b919c7ac0240fa8f361 (DEFAULT_TABLE table=test-table [id=c0e189f053c14304a039eb7cac7e75f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:21.856966 18017 tablet_service.cc:1467] Processing CreateTablet for tablet c73054c4f23b4b919c7ac0240fa8f361 (DEFAULT_TABLE table=test-table [id=c0e189f053c14304a039eb7cac7e75f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:21.857041 18247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73054c4f23b4b919c7ac0240fa8f361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:21.857076 18017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73054c4f23b4b919c7ac0240fa8f361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:21.857887 18785 tablet_bootstrap.cc:492] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283: Bootstrap starting.
I20260808 21:01:21.857923 18786 tablet_bootstrap.cc:492] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: Bootstrap starting.
I20260808 21:01:21.858134 17772 catalog_manager.cc:4841] TS 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531): tablet 3d0923e8c0a84fd9bfaa75ce7f6e04dd (table test-table [id=a9d50530603b4addb1a3a9daea90546a]) successfully deleted
I20260808 21:01:21.858189 18487 tablet_service.cc:1467] Processing CreateTablet for tablet c73054c4f23b4b919c7ac0240fa8f361 (DEFAULT_TABLE table=test-table [id=c0e189f053c14304a039eb7cac7e75f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:21.858229 18785 tablet_bootstrap.cc:654] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:21.858273 18786 tablet_bootstrap.cc:654] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:21.858289 18487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c73054c4f23b4b919c7ac0240fa8f361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:21.858736 18785 tablet_bootstrap.cc:492] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283: No bootstrap required, opened a new log
I20260808 21:01:21.858786 18785 ts_tablet_manager.cc:1397] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:21.858879 18785 raft_consensus.cc:348] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.858923 18785 raft_consensus.cc:374] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:21.858937 18785 raft_consensus.cc:729] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd52192f6f4f4595b82ea0115cb7f283, State: Initialized, Role: FOLLOWER
I20260808 21:01:21.858968 18785 consensus_queue.cc:260] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.859063 18785 ts_tablet_manager.cc:1428] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:21.859459 18784 tablet_bootstrap.cc:492] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: Bootstrap starting.
I20260808 21:01:21.859845 18786 tablet_bootstrap.cc:492] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: No bootstrap required, opened a new log
I20260808 21:01:21.859848 18784 tablet_bootstrap.cc:654] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:21.859910 18786 ts_tablet_manager.cc:1397] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:21.860013 18786 raft_consensus.cc:348] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.860119 18786 raft_consensus.cc:374] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:21.860150 18786 raft_consensus.cc:729] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa470df762c4932b480b4c78fce4649, State: Initialized, Role: FOLLOWER
I20260808 21:01:21.860193 18786 consensus_queue.cc:260] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.860296 18786 ts_tablet_manager.cc:1428] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:21.860610 18784 tablet_bootstrap.cc:492] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: No bootstrap required, opened a new log
I20260808 21:01:21.860661 18784 ts_tablet_manager.cc:1397] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:21.860796 18784 raft_consensus.cc:348] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.860862 18784 raft_consensus.cc:374] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:21.860879 18784 raft_consensus.cc:729] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 960e6517ee974f6e93dd6f1fcefa933d, State: Initialized, Role: FOLLOWER
I20260808 21:01:21.860925 18784 consensus_queue.cc:260] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:21.861047 18784 ts_tablet_manager.cc:1428] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:22.005713 18800 raft_consensus.cc:482] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:22.005846 18800 raft_consensus.cc:504] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:22.006050 18800 leader_election.cc:288] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619), 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:22.006297 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73054c4f23b4b919c7ac0240fa8f361" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa470df762c4932b480b4c78fce4649" is_pre_election: true
I20260808 21:01:22.006409 18285 raft_consensus.cc:2454] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 0.
I20260808 21:01:22.006356 18516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73054c4f23b4b919c7ac0240fa8f361" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d" is_pre_election: true
I20260808 21:01:22.006493 18516 raft_consensus.cc:2454] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 0.
I20260808 21:01:22.006588 17933 leader_election.cc:302] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, cd52192f6f4f4595b82ea0115cb7f283; no voters:
I20260808 21:01:22.006712 18800 raft_consensus.cc:2781] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:22.006767 18800 raft_consensus.cc:482] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:22.006791 18800 raft_consensus.cc:3037] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:22.007454 18800 raft_consensus.cc:504] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:22.007620 18800 leader_election.cc:288] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619), 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531)
I20260808 21:01:22.007784 18285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73054c4f23b4b919c7ac0240fa8f361" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa470df762c4932b480b4c78fce4649"
I20260808 21:01:22.007802 18516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c73054c4f23b4b919c7ac0240fa8f361" candidate_uuid: "cd52192f6f4f4595b82ea0115cb7f283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960e6517ee974f6e93dd6f1fcefa933d"
I20260808 21:01:22.007876 18516 raft_consensus.cc:3037] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:22.007876 18285 raft_consensus.cc:3037] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:22.008575 18285 raft_consensus.cc:2454] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 1.
I20260808 21:01:22.008752 18516 raft_consensus.cc:2454] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd52192f6f4f4595b82ea0115cb7f283 in term 1.
I20260808 21:01:22.008831 17933 leader_election.cc:302] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa470df762c4932b480b4c78fce4649, cd52192f6f4f4595b82ea0115cb7f283; no voters:
I20260808 21:01:22.008929 18800 raft_consensus.cc:2781] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:22.008998 18800 raft_consensus.cc:686] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [term 1 LEADER]: Becoming Leader. State: Replica: cd52192f6f4f4595b82ea0115cb7f283, State: Running, Role: LEADER
I20260808 21:01:22.009084 18800 consensus_queue.cc:237] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } }
I20260808 21:01:22.009766 17792 catalog_manager.cc:5495] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193). New cstate: current_term: 1 leader_uuid: "cd52192f6f4f4595b82ea0115cb7f283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd52192f6f4f4595b82ea0115cb7f283" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:22.044523 18516 raft_consensus.cc:1261] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Refusing update from remote peer cd52192f6f4f4595b82ea0115cb7f283: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:22.044585 18285 raft_consensus.cc:1261] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Refusing update from remote peer cd52192f6f4f4595b82ea0115cb7f283: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:22.044791 18800 consensus_queue.cc:1035] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa470df762c4932b480b4c78fce4649" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:22.044934 18803 consensus_queue.cc:1035] T c73054c4f23b4b919c7ac0240fa8f361 P cd52192f6f4f4595b82ea0115cb7f283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "960e6517ee974f6e93dd6f1fcefa933d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 21:01:22.049865 18745 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 21:01:23.566870 17792 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:23.566977 17792 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:23.567829 17792 catalog_manager.cc:5782] T 00000000000000000000000000000000 P afc9f2060afa47f6a926948d5d3fca92: Sending DeleteTablet for 3 replicas of tablet c73054c4f23b4b919c7ac0240fa8f361
I20260808 21:01:23.568082 18247 tablet_service.cc:1514] Processing DeleteTablet for tablet c73054c4f23b4b919c7ac0240fa8f361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:23 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:40918
I20260808 21:01:23.568091 18017 tablet_service.cc:1514] Processing DeleteTablet for tablet c73054c4f23b4b919c7ac0240fa8f361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:23 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:44502
I20260808 21:01:23.568115 18487 tablet_service.cc:1514] Processing DeleteTablet for tablet c73054c4f23b4b919c7ac0240fa8f361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:23 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:41702
I20260808 21:01:23.568284 18864 tablet_replica.cc:330] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: stopping tablet replica
I20260808 21:01:23.568284 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17902
I20260808 21:01:23.575284 18864 raft_consensus.cc:2229] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:23.575382 18864 raft_consensus.cc:2258] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:23.575699 18864 ts_tablet_manager.cc:1905] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:23.577041 18865 tablet_replica.cc:330] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: stopping tablet replica
I20260808 21:01:23.577122 18865 raft_consensus.cc:2229] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:23.577198 18865 raft_consensus.cc:2258] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:23.577466 18865 ts_tablet_manager.cc:1905] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:23.577553 18864 ts_tablet_manager.cc:1918] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 21:01:23.577618 18864 log.cc:1196] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/c73054c4f23b4b919c7ac0240fa8f361
I20260808 21:01:23.577903 18864 ts_tablet_manager.cc:1939] T c73054c4f23b4b919c7ac0240fa8f361 P 8fa470df762c4932b480b4c78fce4649: Deleting consensus metadata
I20260808 21:01:23.578248 17771 catalog_manager.cc:4841] TS 8fa470df762c4932b480b4c78fce4649 (127.14.146.194:33619): tablet c73054c4f23b4b919c7ac0240fa8f361 (table test-table [id=c0e189f053c14304a039eb7cac7e75f2]) successfully deleted
I20260808 21:01:23.579411 18865 ts_tablet_manager.cc:1918] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 21:01:23.579495 18865 log.cc:1196] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/c73054c4f23b4b919c7ac0240fa8f361
I20260808 21:01:23.579761 18865 ts_tablet_manager.cc:1939] T c73054c4f23b4b919c7ac0240fa8f361 P 960e6517ee974f6e93dd6f1fcefa933d: Deleting consensus metadata
I20260808 21:01:23.580144 17772 catalog_manager.cc:4841] TS 960e6517ee974f6e93dd6f1fcefa933d (127.14.146.195:42531): tablet c73054c4f23b4b919c7ac0240fa8f361 (table test-table [id=c0e189f053c14304a039eb7cac7e75f2]) successfully deleted
W20260808 21:01:23.585601 17772 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:34113 (error 108)
I20260808 21:01:23.585790 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 18147
I20260808 21:01:23.591604 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:23.591341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34113 (local address 127.0.0.1:44544)
0808 21:01:23.591495 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:23.591552 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:34113: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":95,"threads_started":1}
W20260808 21:01:23.592382 17772 catalog_manager.cc:4584] TS cd52192f6f4f4595b82ea0115cb7f283 (127.14.146.193:34113): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c73054c4f23b4b919c7ac0240fa8f361: Network error: Client connection negotiation failed: client connection to 127.14.146.193:34113: connect: Connection refused (error 111)
I20260808 21:01:23.597398 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 18375
I20260808 21:01:23.604773 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17742
2026-08-08T21:01:23Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5981 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:23 dist-test-slave-t3q3 krb5kdc[18875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:23 dist-test-slave-t3q3 krb5kdc[18875](info): set up 2 sockets
Aug 08 21:01:23 dist-test-slave-t3q3 krb5kdc[18875](info): commencing operation
krb5kdc: starting...
W20260808 21:01:24.890278 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:24 dist-test-slave-t3q3 krb5kdc[18875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:25.010808 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:40993
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:39537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:40993
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:25.094472 18897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:25.094749 18897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:25.094794 18897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:25.095986 18897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:25.096063 18897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:25.096112 18897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:25.096145 18897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:25.096163 18897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:25.097687 18897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:40993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:40993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:25.097961 18897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:25.098205 18897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:25.103242 18906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:25.103253 18911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:25.103266 18907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:25.103600 18897 server_base.cc:1034] running on GCE node
I20260808 21:01:25.103861 18897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:25.104223 18897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:25.105391 18897 hybrid_clock.cc:648] HybridClock initialized: now 1786222885105383 us; error 36 us; skew 500 ppm
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[18875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222885, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:25.107849 18897 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:25.108374 18897 webserver.cc:460] Webserver started at http://127.14.146.254:42709/ using document root <none> and password file <none>
I20260808 21:01:25.108613 18897 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:25.108681 18897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:25.108821 18897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:25.109905 18897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "9ea76f7f418d4029b9c4c5937a934776"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "b7e20712dc7e2bd5379abd099cc4460c"
server_key_iv: "514313722391c1018c5e524fbe6e18a1"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.110297 18897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "9ea76f7f418d4029b9c4c5937a934776"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "b7e20712dc7e2bd5379abd099cc4460c"
server_key_iv: "514313722391c1018c5e524fbe6e18a1"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.111685 18897 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:25.112511 18922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.112795 18897 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:25.112907 18897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "9ea76f7f418d4029b9c4c5937a934776"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "b7e20712dc7e2bd5379abd099cc4460c"
server_key_iv: "514313722391c1018c5e524fbe6e18a1"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.112984 18897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:25.122354 18897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:25.124207 18897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:25.124372 18897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:25.128626 18897 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:40993
I20260808 21:01:25.128675 19011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:40993 every 8 connection(s)
I20260808 21:01:25.129041 18897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:25.129957 19012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:25.132274 19012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776: Bootstrap starting.
I20260808 21:01:25.132820 19012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:25.133065 19012 log.cc:824] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:25.133725 19012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776: No bootstrap required, opened a new log
I20260808 21:01:25.135238 19012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea76f7f418d4029b9c4c5937a934776" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40993 } }
I20260808 21:01:25.135375 19012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:25.135428 19012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ea76f7f418d4029b9c4c5937a934776, State: Initialized, Role: FOLLOWER
I20260808 21:01:25.135591 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 18897
I20260808 21:01:25.135592 19012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea76f7f418d4029b9c4c5937a934776" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40993 } }
I20260808 21:01:25.135679 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:25.135679 19012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:25.135725 19012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:25.135787 19012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:25.135880 14923 external_mini_cluster.cc:1428] Setting key 9dc82d38f65401ff1db09723b6ee6c26
I20260808 21:01:25.136482 19012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea76f7f418d4029b9c4c5937a934776" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40993 } }
I20260808 21:01:25.136663 19012 leader_election.cc:302] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ea76f7f418d4029b9c4c5937a934776; no voters:
I20260808 21:01:25.136847 19012 leader_election.cc:288] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:25.136893 19017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:25.137075 19017 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [term 1 LEADER]: Becoming Leader. State: Replica: 9ea76f7f418d4029b9c4c5937a934776, State: Running, Role: LEADER
I20260808 21:01:25.137115 19012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:25.137220 19017 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea76f7f418d4029b9c4c5937a934776" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40993 } }
I20260808 21:01:25.137588 19017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ea76f7f418d4029b9c4c5937a934776. Latest consensus state: current_term: 1 leader_uuid: "9ea76f7f418d4029b9c4c5937a934776" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea76f7f418d4029b9c4c5937a934776" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40993 } } }
I20260808 21:01:25.137863 19017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:25.137781 19019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ea76f7f418d4029b9c4c5937a934776" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ea76f7f418d4029b9c4c5937a934776" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40993 } } }
I20260808 21:01:25.138271 19019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:25.138411 19035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:25.138922 19035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:25.140631 19035 catalog_manager.cc:1347] Generated new cluster ID: 5882d2dee94d49d29217e5f4d908d09d
I20260808 21:01:25.140693 19035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[18875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:25.148825 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:25.136426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38438 (local address 127.14.146.254:40993)
0808 21:01:25.136623 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:25.136632 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:25.136666 (+ 34us) server_negotiation.cc:407] Connection header received
0808 21:01:25.136806 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:25.136813 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:25.136890 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:25.137897 (+ 1007us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:25.138016 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.139561 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.140639 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.141274 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.141383 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:25.144426 (+ 3043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:25.144430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:25.144431 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:25.144444 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:25.146557 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:25.147027 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:25.147031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:25.147032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:25.147179 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:25.147416 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:25.147417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:25.147417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:25.147742 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:25.147917 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:25.148447 (+ 530us) server_negotiation.cc:299] Negotiation successful
0808 21:01:25.148595 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":98,"threads_started":1}
I20260808 21:01:25.149492 19035 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:25.149977 19035 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:25.153542 19035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ea76f7f418d4029b9c4c5937a934776: Generated new TSK 0
I20260808 21:01:25.153715 19035 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:25.186601 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40993
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:39537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:25.269827 19052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:25.270062 19052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:25.270099 19052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:25.271265 19052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:25.271332 19052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:25.271375 19052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:25.272864 19052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:25.273144 19052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:25.273384 19052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:25.278720 19066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:25.278704 19065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:25.278704 19052 server_base.cc:1034] running on GCE node
W20260808 21:01:25.278684 19071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:25.279150 19052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:25.279448 19052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:25.280648 19052 hybrid_clock.cc:648] HybridClock initialized: now 1786222885280622 us; error 37 us; skew 500 ppm
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[18875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222885, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:25.283216 19052 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:25.283710 19052 webserver.cc:460] Webserver started at http://127.14.146.193:36545/ using document root <none> and password file <none>
I20260808 21:01:25.283963 19052 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:25.284035 19052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:25.284240 19052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:25.285310 19052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "43407476c18f4db0b448f0cd1387aab4"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "253ef7376cd799b03bd920b4037382c7"
server_key_iv: "83a3b9a863a5feb62cd2c4f84d2a70af"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.285676 19052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "43407476c18f4db0b448f0cd1387aab4"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "253ef7376cd799b03bd920b4037382c7"
server_key_iv: "83a3b9a863a5feb62cd2c4f84d2a70af"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.287060 19052 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:25.287842 19084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.288038 19052 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:25.288188 19052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "43407476c18f4db0b448f0cd1387aab4"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "253ef7376cd799b03bd920b4037382c7"
server_key_iv: "83a3b9a863a5feb62cd2c4f84d2a70af"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.288275 19052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:25.300853 19052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:25.302722 19052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:25.302908 19052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:25.303180 19052 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:25.303537 19052 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:25.303571 19052 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.303619 19052 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:25.303645 19052 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.309547 19052 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:38493
I20260808 21:01:25.309604 19283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:38493 every 8 connection(s)
I20260808 21:01:25.309917 19052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:25.312656 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 19052
I20260808 21:01:25.312759 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:25.312935 14923 external_mini_cluster.cc:1428] Setting key 0f14dd1d46fdb39a11f30a9e2959a8ed
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[18875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222885, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:25.320785 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:25.310625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:48647 (local address 127.14.146.254:40993)
0808 21:01:25.310712 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:25.310714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:25.310888 (+ 174us) server_negotiation.cc:407] Connection header received
0808 21:01:25.311348 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:25.311350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:25.311364 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:25.311417 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:25.312404 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.313202 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.314897 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.315098 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.315149 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:25.317797 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:25.317798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:25.317798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:25.317805 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:25.319259 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:25.319769 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:25.319769 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:25.319770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:25.319821 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:25.320140 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:25.320141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:25.320141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:25.320250 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:25.320304 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:25.320650 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 21:01:25.320722 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 21:01:25.321033 19288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:25.310575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40993 (local address 127.14.146.193:48647)
0808 21:01:25.310764 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:25.310803 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:25.311263 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:25.311470 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:25.311473 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:25.312040 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:25.312322 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:25.312327 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.313498 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.313499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:25.314800 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:25.314804 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.315183 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.315185 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:25.315356 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:25.315937 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:25.315945 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:25.317692 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:25.319346 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:25.319354 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:25.319357 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:25.319691 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:25.319894 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:25.319895 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:25.319896 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:25.320047 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:25.320321 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:25.320329 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:25.320502 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 21:01:25.320615 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 21:01:25.320797 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":103,"threads_started":1}
I20260808 21:01:25.321646 19285 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40993
I20260808 21:01:25.321749 19285 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:25.321946 19285 heartbeater.cc:511] Master 127.14.146.254:40993 requested a full tablet report, sending...
I20260808 21:01:25.322456 18948 ts_manager.cc:194] Registered new tserver with Master: 43407476c18f4db0b448f0cd1387aab4 (127.14.146.193:38493)
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:01:25.323100 18948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:48647
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:25.339041 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40993
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:39537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:25.422200 19292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:25.422428 19292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:25.422468 19292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:25.423599 19292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:25.423664 19292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:25.423712 19292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:25.425215 19292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:25.425480 19292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:25.425709 19292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:25.431480 19298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:25.431459 19301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:25.431413 19303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:25.431500 19292 server_base.cc:1034] running on GCE node
I20260808 21:01:25.431901 19292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:25.432188 19292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:25.433359 19292 hybrid_clock.cc:648] HybridClock initialized: now 1786222885433340 us; error 38 us; skew 500 ppm
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[18875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222885, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:25.435846 19292 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:25.436353 19292 webserver.cc:460] Webserver started at http://127.14.146.194:41951/ using document root <none> and password file <none>
I20260808 21:01:25.436582 19292 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:25.436652 19292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:25.436795 19292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:25.437923 19292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "1d61df016267441eac380431ee4a82fe"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "fb8c0ae20f107c9dc117e4b5e455a7f0"
server_key_iv: "5152e94c815b2efa2bf8707b1e50daad"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.438381 19292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "1d61df016267441eac380431ee4a82fe"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "fb8c0ae20f107c9dc117e4b5e455a7f0"
server_key_iv: "5152e94c815b2efa2bf8707b1e50daad"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.439720 19292 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:25.440500 19315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.440673 19292 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.440784 19292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "1d61df016267441eac380431ee4a82fe"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "fb8c0ae20f107c9dc117e4b5e455a7f0"
server_key_iv: "5152e94c815b2efa2bf8707b1e50daad"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.440861 19292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:25.449779 19292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:25.451486 19292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:25.451647 19292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:25.451875 19292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:25.452247 19292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:25.452304 19292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.452345 19292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:25.452373 19292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.458269 19292 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:46163
I20260808 21:01:25.458307 19499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:46163 every 8 connection(s)
I20260808 21:01:25.458626 19292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[18875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222885, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:25.464300 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 19292
I20260808 21:01:25.464390 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:25.464593 14923 external_mini_cluster.cc:1428] Setting key d1a620c8253a56b7eb3dce9fce7f8dda
I20260808 21:01:25.467857 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:25.459339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:53377 (local address 127.14.146.254:40993)
0808 21:01:25.459425 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:25.459427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:25.459579 (+ 152us) server_negotiation.cc:407] Connection header received
0808 21:01:25.460022 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:25.460023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:25.460033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:25.460149 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:25.461023 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.461516 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.462437 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.462616 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.462667 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:25.464844 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:25.464845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:25.464846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:25.464853 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:25.466303 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:25.466811 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:25.466811 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:25.466812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:25.466880 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:25.467184 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:25.467185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:25.467185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:25.467344 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:25.467417 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:25.467651 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 21:01:25.467739 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 21:01:25.467882 19503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:25.459295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40993 (local address 127.14.146.194:53377)
0808 21:01:25.459465 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:25.459500 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:25.459944 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:25.460214 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:25.460218 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:25.460766 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:25.460948 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:25.460952 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.461593 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.461594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:25.462366 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:25.462368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.462687 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.462687 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:25.462784 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:25.463279 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:25.463286 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:25.464750 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:25.466389 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:25.466397 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:25.466399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:25.466734 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:25.466959 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:25.466960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:25.466960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:25.467110 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:25.467412 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:25.467417 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:25.467525 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 21:01:25.467606 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:01:25.467732 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
I20260808 21:01:25.468369 19500 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40993
I20260808 21:01:25.468492 19500 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:25.468662 19500 heartbeater.cc:511] Master 127.14.146.254:40993 requested a full tablet report, sending...
I20260808 21:01:25.469086 18948 ts_manager.cc:194] Registered new tserver with Master: 1d61df016267441eac380431ee4a82fe (127.14.146.194:46163)
I20260808 21:01:25.469621 18948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:53377
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:25.492206 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40993
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:39537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:25.574944 19508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:25.575171 19508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:25.575214 19508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:25.576414 19508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:25.576473 19508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:25.576516 19508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:25.577970 19508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:25.578231 19508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:25.578461 19508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:25.583500 19524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:25.583490 19528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:25.583469 19523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:25.583524 19508 server_base.cc:1034] running on GCE node
I20260808 21:01:25.583966 19508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:25.584236 19508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:25.585387 19508 hybrid_clock.cc:648] HybridClock initialized: now 1786222885585373 us; error 28 us; skew 500 ppm
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[18875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222885, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:25.587955 19508 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:25.588409 19508 webserver.cc:460] Webserver started at http://127.14.146.195:34397/ using document root <none> and password file <none>
I20260808 21:01:25.588634 19508 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:25.588678 19508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:25.588856 19508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:25.589907 19508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "cb6132db338042b4ba32633e77d2e63b"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "55559dd3cd1a6d4bb919e15c0f5e7ac3"
server_key_iv: "ec447d70ae89e67f058b48313ba3f670"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.590353 19508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "cb6132db338042b4ba32633e77d2e63b"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "55559dd3cd1a6d4bb919e15c0f5e7ac3"
server_key_iv: "ec447d70ae89e67f058b48313ba3f670"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.591737 19508 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:01:25.592641 19541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.592878 19508 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:25.592978 19508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "cb6132db338042b4ba32633e77d2e63b"
format_stamp: "Formatted at 2026-08-08 21:01:25 on dist-test-slave-t3q3"
server_key: "55559dd3cd1a6d4bb919e15c0f5e7ac3"
server_key_iv: "ec447d70ae89e67f058b48313ba3f670"
server_key_version: "encryptionkey@0"
I20260808 21:01:25.593070 19508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:25.608116 19508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:25.610419 19508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:25.610534 19508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:25.610711 19508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:25.611073 19508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:25.611112 19508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.611135 19508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:25.611251 19508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:25.617412 19508 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:45929
I20260808 21:01:25.617492 19713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:45929 every 8 connection(s)
I20260808 21:01:25.617822 19508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[18875](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222885, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:25.626870 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:25.618571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:59083 (local address 127.14.146.254:40993)
0808 21:01:25.618660 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:25.618663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:25.618846 (+ 183us) server_negotiation.cc:407] Connection header received
0808 21:01:25.619341 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:25.619342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:25.619352 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:25.619405 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:25.620378 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.620866 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.621888 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.622064 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.622115 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:25.624312 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:25.624313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:25.624314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:25.624320 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:25.625597 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:25.625967 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:25.625968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:25.625969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:25.626021 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:25.626347 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:25.626347 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:25.626348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:25.626447 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:25.626498 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:25.626746 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 21:01:25.626806 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 21:01:25.627136 19723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:25.618541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40993 (local address 127.14.146.195:59083)
0808 21:01:25.618719 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:25.618754 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:25.619247 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:25.619455 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:25.619459 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:25.620029 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:25.620302 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:25.620307 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.620973 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.620974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:25.621811 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:25.621814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:25.622135 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:25.622136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:25.622235 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:25.622762 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:25.622771 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:25.624229 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:25.625678 (+ 1449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:25.625683 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:25.625685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:25.625899 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:25.626162 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:25.626163 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:25.626163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:25.626280 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:25.626508 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:25.626513 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:25.626625 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 21:01:25.626710 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:01:25.626828 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":105,"threads_started":1}
I20260808 21:01:25.627532 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 19508
I20260808 21:01:25.627656 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:25.627758 19715 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40993
I20260808 21:01:25.627846 14923 external_mini_cluster.cc:1428] Setting key 7f7fb7f9e73047619333cb76257450e9
I20260808 21:01:25.627878 19715 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:25.628095 19715 heartbeater.cc:511] Master 127.14.146.254:40993 requested a full tablet report, sending...
I20260808 21:01:25.628504 18948 ts_manager.cc:194] Registered new tserver with Master: cb6132db338042b4ba32633e77d2e63b (127.14.146.195:45929)
I20260808 21:01:25.628888 18948 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:59083
I20260808 21:01:25.629421 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 21:01:25.642063 19016 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:25.641167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38442 (local address 127.14.146.254:40993)
0808 21:01:25.641247 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:25.641249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:25.641348 (+ 99us) server_negotiation.cc:407] Connection header received
0808 21:01:25.641405 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:25.641406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:25.641415 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:25.641463 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:25.641975 (+ 512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38442: BlockingRecv error: recv got EOF from 127.0.0.1:38442 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:01:25.642903 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 19052
I20260808 21:01:25.663151 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 19292
I20260808 21:01:25.679912 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 19508
I20260808 21:01:25.686375 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 18897
2026-08-08T21:01:25Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2082 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[19739](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[19739](info): set up 2 sockets
Aug 08 21:01:25 dist-test-slave-t3q3 krb5kdc[19739](info): commencing operation
krb5kdc: starting...
W20260808 21:01:26.936941 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:27 dist-test-slave-t3q3 krb5kdc[19739](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:27.060738 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:44511
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:40523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:44511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:27.144924 19755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:27.145191 19755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:27.145229 19755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:27.146425 19755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:27.146502 19755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:27.146534 19755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:27.146564 19755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:27.146595 19755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:27.148156 19755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:40523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:44511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:44511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:27.148447 19755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:27.148689 19755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:27.153810 19760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:27.153789 19761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:27.153874 19755 server_base.cc:1034] running on GCE node
W20260808 21:01:27.153782 19766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:27.154285 19755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:27.154567 19755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:27.155714 19755 hybrid_clock.cc:648] HybridClock initialized: now 1786222887155701 us; error 30 us; skew 500 ppm
Aug 08 21:01:27 dist-test-slave-t3q3 krb5kdc[19739](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222887, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:27.158291 19755 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:27.158759 19755 webserver.cc:460] Webserver started at http://127.14.146.254:39015/ using document root <none> and password file <none>
I20260808 21:01:27.158993 19755 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:27.159039 19755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:27.159188 19755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:27.160302 19755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "8a630bac1fb94c2eaaec76a121432e31"
format_stamp: "Formatted at 2026-08-08 21:01:27 on dist-test-slave-t3q3"
server_key: "bb6b2b98ce295410b9f6aeb6d3c0a53f"
server_key_iv: "94daa4a0ad9867abd04f662db5d8a366"
server_key_version: "encryptionkey@0"
I20260808 21:01:27.160717 19755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "8a630bac1fb94c2eaaec76a121432e31"
format_stamp: "Formatted at 2026-08-08 21:01:27 on dist-test-slave-t3q3"
server_key: "bb6b2b98ce295410b9f6aeb6d3c0a53f"
server_key_iv: "94daa4a0ad9867abd04f662db5d8a366"
server_key_version: "encryptionkey@0"
I20260808 21:01:27.162022 19755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:27.162729 19781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:27.162900 19755 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:27.163007 19755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "8a630bac1fb94c2eaaec76a121432e31"
format_stamp: "Formatted at 2026-08-08 21:01:27 on dist-test-slave-t3q3"
server_key: "bb6b2b98ce295410b9f6aeb6d3c0a53f"
server_key_iv: "94daa4a0ad9867abd04f662db5d8a366"
server_key_version: "encryptionkey@0"
I20260808 21:01:27.163079 19755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:27.181589 19755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:27.183800 19755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:27.183960 19755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:27.188352 19755 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:44511
I20260808 21:01:27.188405 19866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:44511 every 8 connection(s)
I20260808 21:01:27.188951 19755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:27.189620 19867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:27.191879 19867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31: Bootstrap starting.
I20260808 21:01:27.192627 19867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:27.192878 19867 log.cc:824] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:27.193526 19867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31: No bootstrap required, opened a new log
I20260808 21:01:27.195046 19867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a630bac1fb94c2eaaec76a121432e31" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44511 } }
I20260808 21:01:27.195185 19867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:27.195207 19867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a630bac1fb94c2eaaec76a121432e31, State: Initialized, Role: FOLLOWER
I20260808 21:01:27.195343 19867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a630bac1fb94c2eaaec76a121432e31" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44511 } }
I20260808 21:01:27.195430 19867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:27.195456 19867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:27.195484 19867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:27.195794 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 19755
I20260808 21:01:27.195900 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:27.196127 14923 external_mini_cluster.cc:1428] Setting key 914101b2e4037e3a93dc849cf9ea8f15
I20260808 21:01:27.196672 19867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a630bac1fb94c2eaaec76a121432e31" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44511 } }
I20260808 21:01:27.196831 19867 leader_election.cc:302] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a630bac1fb94c2eaaec76a121432e31; no voters:
I20260808 21:01:27.197026 19867 leader_election.cc:288] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:27.197067 19874 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:27.197176 19874 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [term 1 LEADER]: Becoming Leader. State: Replica: 8a630bac1fb94c2eaaec76a121432e31, State: Running, Role: LEADER
I20260808 21:01:27.197289 19867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:27.197316 19874 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a630bac1fb94c2eaaec76a121432e31" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44511 } }
I20260808 21:01:27.197773 19875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a630bac1fb94c2eaaec76a121432e31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a630bac1fb94c2eaaec76a121432e31" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44511 } } }
I20260808 21:01:27.197881 19875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:27.198441 19878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a630bac1fb94c2eaaec76a121432e31. Latest consensus state: current_term: 1 leader_uuid: "8a630bac1fb94c2eaaec76a121432e31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a630bac1fb94c2eaaec76a121432e31" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44511 } } }
I20260808 21:01:27.198539 19878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:27.198727 19890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:27.199441 19890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:27.201202 19890 catalog_manager.cc:1347] Generated new cluster ID: f5e458fd13dc4a9aa974855c21020ee2
I20260808 21:01:27.201256 19890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:01:27 dist-test-slave-t3q3 krb5kdc[19739](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:27.210269 19873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:27.196588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45926 (local address 127.14.146.254:44511)
0808 21:01:27.196774 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:27.196785 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:27.196818 (+ 33us) server_negotiation.cc:407] Connection header received
0808 21:01:27.196926 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:27.196931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:27.196998 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:27.197929 (+ 931us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:27.198036 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:27.199430 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:27.200275 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:27.200892 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:27.201024 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:27.206705 (+ 5681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:27.206709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:27.206710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:27.206721 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:27.208611 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:27.209016 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:27.209019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:27.209019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:27.209137 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:27.209364 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:27.209365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:27.209365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:27.209645 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:27.209803 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:27.209923 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 21:01:27.210054 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":105,"threads_started":1}
I20260808 21:01:27.210678 19890 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:27.211102 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:01:27.211360 19890 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:27.222112 19890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a630bac1fb94c2eaaec76a121432e31: Generated new TSK 0
I20260808 21:01:27.222322 19890 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:01:27.226327 19873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:27.222707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45942 (local address 127.14.146.254:44511)
0808 21:01:27.222746 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:27.222748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:27.222863 (+ 115us) server_negotiation.cc:407] Connection header received
0808 21:01:27.222894 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:27.222895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:27.222905 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:27.222977 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:27.223304 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:27.224109 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:27.224822 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:27.225145 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:27.225218 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:27.225844 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:27.225845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:27.225846 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:27.226088 (+ 242us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:27.226106 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:27.226114 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:27.226179 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:27.226228 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 21:01:27.226252 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:01:27.228950 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 19755
2026-08-08T21:01:27Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1543 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:27 dist-test-slave-t3q3 krb5kdc[19921](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:27 dist-test-slave-t3q3 krb5kdc[19921](info): set up 2 sockets
Aug 08 21:01:27 dist-test-slave-t3q3 krb5kdc[19921](info): commencing operation
krb5kdc: starting...
W20260808 21:01:28.506820 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:28 dist-test-slave-t3q3 krb5kdc[19921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:28.632798 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34357
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:34357
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:28.716431 19941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:28.716660 19941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:28.716698 19941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:28.717831 19941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:28.717895 19941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:28.717921 19941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:28.717957 19941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:28.717979 19941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:28.719470 19941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:34357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:28.719739 19941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:28.719969 19941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:28.724936 19953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:28.724943 19950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:28.724987 19948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:28.725258 19941 server_base.cc:1034] running on GCE node
I20260808 21:01:28.725548 19941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:28.725865 19941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:28.727026 19941 hybrid_clock.cc:648] HybridClock initialized: now 1786222888727015 us; error 42 us; skew 500 ppm
Aug 08 21:01:28 dist-test-slave-t3q3 krb5kdc[19921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222888, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:28.735210 19941 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:28.735829 19941 webserver.cc:460] Webserver started at http://127.14.146.254:39873/ using document root <none> and password file <none>
I20260808 21:01:28.736156 19941 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:28.736230 19941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:28.736433 19941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:28.737526 19941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "e96cff0592934250aa113c7e6b0c058e"
format_stamp: "Formatted at 2026-08-08 21:01:28 on dist-test-slave-t3q3"
server_key: "366445af4e56532b7f098821384a9a7d"
server_key_iv: "b91e72f89312c3c9202809ec8723072d"
server_key_version: "encryptionkey@0"
I20260808 21:01:28.737874 19941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "e96cff0592934250aa113c7e6b0c058e"
format_stamp: "Formatted at 2026-08-08 21:01:28 on dist-test-slave-t3q3"
server_key: "366445af4e56532b7f098821384a9a7d"
server_key_iv: "b91e72f89312c3c9202809ec8723072d"
server_key_version: "encryptionkey@0"
I20260808 21:01:28.739126 19941 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:28.739763 19963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:28.739931 19941 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:28.740031 19941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "e96cff0592934250aa113c7e6b0c058e"
format_stamp: "Formatted at 2026-08-08 21:01:28 on dist-test-slave-t3q3"
server_key: "366445af4e56532b7f098821384a9a7d"
server_key_iv: "b91e72f89312c3c9202809ec8723072d"
server_key_version: "encryptionkey@0"
I20260808 21:01:28.740130 19941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:28.764724 19941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:28.766610 19941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:28.766780 19941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:28.770787 19941 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:34357
I20260808 21:01:28.770870 20048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:34357 every 8 connection(s)
I20260808 21:01:28.771222 19941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:28.772424 20049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:28.774740 20049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e: Bootstrap starting.
I20260808 21:01:28.775327 20049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:28.775602 20049 log.cc:824] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:28.776337 20049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e: No bootstrap required, opened a new log
I20260808 21:01:28.777894 20049 raft_consensus.cc:348] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96cff0592934250aa113c7e6b0c058e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34357 } }
I20260808 21:01:28.778044 20049 raft_consensus.cc:374] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:28.778100 20049 raft_consensus.cc:729] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e96cff0592934250aa113c7e6b0c058e, State: Initialized, Role: FOLLOWER
I20260808 21:01:28.778255 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 19941
I20260808 21:01:28.778285 20049 consensus_queue.cc:260] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96cff0592934250aa113c7e6b0c058e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34357 } }
I20260808 21:01:28.778357 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:28.778378 20049 raft_consensus.cc:388] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:28.778422 20049 raft_consensus.cc:482] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:28.778472 20049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:28.778539 14923 external_mini_cluster.cc:1428] Setting key 1c4e6f85647c79015523a20b1260b057
I20260808 21:01:28.779444 20049 raft_consensus.cc:504] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96cff0592934250aa113c7e6b0c058e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34357 } }
I20260808 21:01:28.779574 20049 leader_election.cc:302] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e96cff0592934250aa113c7e6b0c058e; no voters:
I20260808 21:01:28.779762 20049 leader_election.cc:288] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:28.779780 20054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:28.779973 20054 raft_consensus.cc:686] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [term 1 LEADER]: Becoming Leader. State: Replica: e96cff0592934250aa113c7e6b0c058e, State: Running, Role: LEADER
I20260808 21:01:28.780031 20049 sys_catalog.cc:564] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:28.780160 20054 consensus_queue.cc:237] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96cff0592934250aa113c7e6b0c058e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34357 } }
I20260808 21:01:28.780601 20058 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e96cff0592934250aa113c7e6b0c058e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96cff0592934250aa113c7e6b0c058e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34357 } } }
I20260808 21:01:28.780674 20058 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:28.780874 20059 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e96cff0592934250aa113c7e6b0c058e. Latest consensus state: current_term: 1 leader_uuid: "e96cff0592934250aa113c7e6b0c058e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96cff0592934250aa113c7e6b0c058e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34357 } } }
I20260808 21:01:28.780989 20059 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:28.781370 20064 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:28.781874 20064 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:28.783665 20064 catalog_manager.cc:1347] Generated new cluster ID: 05e19cc310b94ca2a3c0220cdee0fb7b
I20260808 21:01:28.783861 20064 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:01:28 dist-test-slave-t3q3 krb5kdc[19921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:28.790104 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:28.779042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50050 (local address 127.14.146.254:34357)
0808 21:01:28.779235 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:28.779242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:28.779272 (+ 30us) server_negotiation.cc:407] Connection header received
0808 21:01:28.779367 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:28.779373 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:28.779413 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:28.779519 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:28.780398 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:28.781904 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:28.782898 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:28.783467 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:28.783599 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:28.786468 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:28.786472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:28.786472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:28.786484 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:28.788430 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:28.788839 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:28.788842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:28.788842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:28.788958 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:28.789178 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:28.789179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:28.789179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:28.789469 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:28.789615 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:28.789754 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 21:01:28.789884 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":102,"threads_started":1}
I20260808 21:01:28.799669 20064 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:28.800264 20064 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:28.806720 20064 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e96cff0592934250aa113c7e6b0c058e: Generated new TSK 0
I20260808 21:01:28.806888 20064 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:28.838344 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34357
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:28.923355 20089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:28.923547 20089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:28.923569 20089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:28.924767 20089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:28.924815 20089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:28.924847 20089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:28.926321 20089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:28.926553 20089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:28.926808 20089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:28.931977 20095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:28.932024 20089 server_base.cc:1034] running on GCE node
W20260808 21:01:28.932170 20096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:28.932040 20099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:28.932552 20089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:28.932807 20089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:28.933950 20089 hybrid_clock.cc:648] HybridClock initialized: now 1786222888933934 us; error 32 us; skew 500 ppm
Aug 08 21:01:28 dist-test-slave-t3q3 krb5kdc[19921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222888, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:28.936404 20089 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:28.936883 20089 webserver.cc:460] Webserver started at http://127.14.146.193:42377/ using document root <none> and password file <none>
I20260808 21:01:28.937131 20089 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:28.937178 20089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:28.937307 20089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:28.938356 20089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "abe6609b81f144dc8f51ecb5c93e89a4"
format_stamp: "Formatted at 2026-08-08 21:01:28 on dist-test-slave-t3q3"
server_key: "f1a73f547d98b31e638c754d857e1ba4"
server_key_iv: "5405ee8491419d64930c11fe995697f3"
server_key_version: "encryptionkey@0"
I20260808 21:01:28.938711 20089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "abe6609b81f144dc8f51ecb5c93e89a4"
format_stamp: "Formatted at 2026-08-08 21:01:28 on dist-test-slave-t3q3"
server_key: "f1a73f547d98b31e638c754d857e1ba4"
server_key_iv: "5405ee8491419d64930c11fe995697f3"
server_key_version: "encryptionkey@0"
I20260808 21:01:28.940028 20089 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:01:28.940805 20115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:28.940981 20089 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:28.941072 20089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "abe6609b81f144dc8f51ecb5c93e89a4"
format_stamp: "Formatted at 2026-08-08 21:01:28 on dist-test-slave-t3q3"
server_key: "f1a73f547d98b31e638c754d857e1ba4"
server_key_iv: "5405ee8491419d64930c11fe995697f3"
server_key_version: "encryptionkey@0"
I20260808 21:01:28.941143 20089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:28.952960 20089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:28.954983 20089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:28.955137 20089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:28.955420 20089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:28.955767 20089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:28.955806 20089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:28.955845 20089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:28.955875 20089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:28.961910 20089 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:37135
I20260808 21:01:28.961987 20288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:37135 every 8 connection(s)
I20260808 21:01:28.962358 20089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:28.963902 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 20089
I20260808 21:01:28.964020 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:28.964251 14923 external_mini_cluster.cc:1428] Setting key db8d157e57b2993449a65f67af54318e
Aug 08 21:01:28 dist-test-slave-t3q3 krb5kdc[19921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222888, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:28.973744 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:28.963223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:44937 (local address 127.14.146.254:34357)
0808 21:01:28.963295 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:28.963298 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:28.963530 (+ 232us) server_negotiation.cc:407] Connection header received
0808 21:01:28.964398 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:28.964399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:28.964428 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:28.964507 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:28.965929 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:28.966446 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:28.967636 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:28.967849 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:28.967923 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:28.970605 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:28.970607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:28.970607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:28.970616 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:28.972201 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:28.972661 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:28.972663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:28.972664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:28.972733 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:28.973008 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:28.973009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:28.973009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:28.973163 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:28.973236 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:28.973543 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 21:01:28.973644 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 21:01:28.973953 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:28.963212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34357 (local address 127.14.146.193:44937)
0808 21:01:28.963393 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:28.963434 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:28.964249 (+ 815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:28.964613 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:28.964618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:28.965493 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:28.965818 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:28.965826 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:28.966543 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:28.966544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:28.967531 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:28.967534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:28.967933 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:28.967934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:28.968125 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:28.968658 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:28.968669 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:28.970468 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:28.972314 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:28.972323 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:28.972325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:28.972581 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:28.972802 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:28.972803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:28.972804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:28.972928 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:28.973238 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:28.973246 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:28.973401 (+ 155us) client_negotiation.cc:769] Sending connection context
0808 21:01:28.973507 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 21:01:28.973693 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:01:28.974535 20289 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34357
I20260808 21:01:28.974653 20289 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:28.974876 20289 heartbeater.cc:511] Master 127.14.146.254:34357 requested a full tablet report, sending...
I20260808 21:01:28.975497 19992 ts_manager.cc:194] Registered new tserver with Master: abe6609b81f144dc8f51ecb5c93e89a4 (127.14.146.193:37135)
I20260808 21:01:28.976246 19992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:44937
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:28.992733 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34357
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:29.080271 20297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:29.080475 20297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:29.080498 20297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:29.081712 20297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:29.081755 20297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:29.081781 20297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:29.083214 20297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:29.083400 20297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:29.083573 20297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:29.088636 20306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:29.088651 20308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:29.088667 20297 server_base.cc:1034] running on GCE node
W20260808 21:01:29.088645 20304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:29.089082 20297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:29.089356 20297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:29.090516 20297 hybrid_clock.cc:648] HybridClock initialized: now 1786222889090509 us; error 35 us; skew 500 ppm
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[19921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222889, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:29.093034 20297 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:29.093501 20297 webserver.cc:460] Webserver started at http://127.14.146.194:45883/ using document root <none> and password file <none>
I20260808 21:01:29.093726 20297 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:29.093793 20297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:29.093940 20297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:29.095014 20297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "d4c9e3c6aaa849b0a36d65dd8250dc03"
format_stamp: "Formatted at 2026-08-08 21:01:29 on dist-test-slave-t3q3"
server_key: "f720a1719f84096601d2e3942763bfc7"
server_key_iv: "f7c7ac0216242becab8abb2a967ee510"
server_key_version: "encryptionkey@0"
I20260808 21:01:29.095388 20297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "d4c9e3c6aaa849b0a36d65dd8250dc03"
format_stamp: "Formatted at 2026-08-08 21:01:29 on dist-test-slave-t3q3"
server_key: "f720a1719f84096601d2e3942763bfc7"
server_key_iv: "f7c7ac0216242becab8abb2a967ee510"
server_key_version: "encryptionkey@0"
I20260808 21:01:29.096771 20297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:29.097466 20323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:29.097636 20297 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:29.097735 20297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "d4c9e3c6aaa849b0a36d65dd8250dc03"
format_stamp: "Formatted at 2026-08-08 21:01:29 on dist-test-slave-t3q3"
server_key: "f720a1719f84096601d2e3942763bfc7"
server_key_iv: "f7c7ac0216242becab8abb2a967ee510"
server_key_version: "encryptionkey@0"
I20260808 21:01:29.097813 20297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:29.105108 20297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:29.107170 20297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:29.107366 20297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:29.107601 20297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:29.107918 20297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:29.107971 20297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:29.108021 20297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:29.108047 20297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:29.114161 20297 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:36557
I20260808 21:01:29.114212 20488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:36557 every 8 connection(s)
I20260808 21:01:29.114549 20297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:29.118393 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 20297
I20260808 21:01:29.118526 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:29.118716 14923 external_mini_cluster.cc:1428] Setting key dd0a8b5bb5ae234c2bf8c9be0d4995ed
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[19921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222889, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:29.124927 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:29.115290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:44479 (local address 127.14.146.254:34357)
0808 21:01:29.115369 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:29.115370 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:29.115579 (+ 209us) server_negotiation.cc:407] Connection header received
0808 21:01:29.116110 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:29.116112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:29.116127 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:29.116190 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:29.117167 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.117681 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.118809 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.119099 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.119184 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:29.121808 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:29.121809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:29.121810 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:29.121818 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:29.123473 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:29.123863 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:29.123864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:29.123865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:29.123934 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:29.124234 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:29.124236 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:29.124236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:29.124396 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:29.124478 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:29.124718 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 21:01:29.124816 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:01:29.124959 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:29.115270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34357 (local address 127.14.146.194:44479)
0808 21:01:29.115448 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:29.115491 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:29.115984 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:29.116250 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:29.116254 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:29.116845 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:29.117053 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:29.117058 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.117773 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.117774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:29.118720 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:29.118723 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.119195 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.119196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:29.119361 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:29.119948 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:29.119956 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:29.121709 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:29.123551 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:29.123557 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:29.123559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:29.123790 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:29.124012 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:29.124013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:29.124013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:29.124172 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:29.124465 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:29.124471 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:29.124586 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 21:01:29.124671 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:01:29.124801 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260808 21:01:29.125461 20490 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34357
I20260808 21:01:29.125571 20490 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:29.125749 20490 heartbeater.cc:511] Master 127.14.146.254:34357 requested a full tablet report, sending...
I20260808 21:01:29.126174 19992 ts_manager.cc:194] Registered new tserver with Master: d4c9e3c6aaa849b0a36d65dd8250dc03 (127.14.146.194:36557)
I20260808 21:01:29.126734 19992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:44479
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:29.146384 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34357
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:29.228958 20500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:29.229166 20500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:29.229189 20500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:29.230331 20500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:29.230403 20500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:29.230432 20500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:29.231869 20500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34357
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:29.232148 20500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:29.232396 20500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:29.237468 20510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:29.237416 20508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:29.237418 20507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:29.237452 20500 server_base.cc:1034] running on GCE node
I20260808 21:01:29.237825 20500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:29.238058 20500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:29.239197 20500 hybrid_clock.cc:648] HybridClock initialized: now 1786222889239185 us; error 28 us; skew 500 ppm
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[19921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222889, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:29.241736 20500 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:29.242201 20500 webserver.cc:460] Webserver started at http://127.14.146.195:39263/ using document root <none> and password file <none>
I20260808 21:01:29.242427 20500 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:29.242472 20500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:29.242633 20500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:29.243731 20500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "183c8f151bb1413a954b7bdd9ebb4ec7"
format_stamp: "Formatted at 2026-08-08 21:01:29 on dist-test-slave-t3q3"
server_key: "22d7c94f7a1111bc8513a3b268ac19f4"
server_key_iv: "efb2e2414ff74b208620cad06e8495e2"
server_key_version: "encryptionkey@0"
I20260808 21:01:29.244146 20500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "183c8f151bb1413a954b7bdd9ebb4ec7"
format_stamp: "Formatted at 2026-08-08 21:01:29 on dist-test-slave-t3q3"
server_key: "22d7c94f7a1111bc8513a3b268ac19f4"
server_key_iv: "efb2e2414ff74b208620cad06e8495e2"
server_key_version: "encryptionkey@0"
I20260808 21:01:29.245477 20500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:29.246199 20523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:29.246366 20500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:29.246470 20500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "183c8f151bb1413a954b7bdd9ebb4ec7"
format_stamp: "Formatted at 2026-08-08 21:01:29 on dist-test-slave-t3q3"
server_key: "22d7c94f7a1111bc8513a3b268ac19f4"
server_key_iv: "efb2e2414ff74b208620cad06e8495e2"
server_key_version: "encryptionkey@0"
I20260808 21:01:29.246539 20500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:29.255131 20500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:29.256958 20500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:29.257114 20500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:29.257339 20500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:29.257639 20500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:29.257691 20500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:29.257725 20500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:29.257752 20500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:29.263582 20500 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:42973
I20260808 21:01:29.263626 20702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:42973 every 8 connection(s)
I20260808 21:01:29.263936 20500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[19921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222889, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:29.271831 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 20500
I20260808 21:01:29.271948 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:29.272188 14923 external_mini_cluster.cc:1428] Setting key 08fde365503b3b96af398998428633de
I20260808 21:01:29.273015 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:29.264665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:42781 (local address 127.14.146.254:34357)
0808 21:01:29.264730 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:29.264732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:29.264955 (+ 223us) server_negotiation.cc:407] Connection header received
0808 21:01:29.265449 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:29.265450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:29.265460 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:29.265519 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:29.266418 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.266918 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.267893 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.268140 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.268202 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:29.270234 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:29.270235 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:29.270235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:29.270242 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:29.271420 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:29.271881 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:29.271882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:29.271882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:29.271963 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:29.272293 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:29.272294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:29.272294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:29.272447 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:29.272513 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:29.272830 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 21:01:29.272916 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 21:01:29.273245 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:29.264618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34357 (local address 127.14.146.195:42781)
0808 21:01:29.264814 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:29.264857 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:29.265362 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:29.265572 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:29.265576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:29.266142 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:29.266341 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:29.266346 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.266993 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.266994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:29.267819 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:29.267821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.268233 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.268234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:29.268342 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:29.268796 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:29.268805 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:29.270148 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:29.271488 (+ 1340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:29.271493 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:29.271495 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:29.271808 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:29.272037 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:29.272038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:29.272038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:29.272209 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:29.272506 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:29.272513 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:29.272657 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 21:01:29.272793 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 21:01:29.272968 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":99,"threads_started":1}
I20260808 21:01:29.273665 20703 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34357
I20260808 21:01:29.273777 20703 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:29.273952 20703 heartbeater.cc:511] Master 127.14.146.254:34357 requested a full tablet report, sending...
I20260808 21:01:29.274297 19992 ts_manager.cc:194] Registered new tserver with Master: 183c8f151bb1413a954b7bdd9ebb4ec7 (127.14.146.195:42973)
I20260808 21:01:29.274636 19992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:42781
I20260808 21:01:29.284161 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[19921](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222889, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[19921](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222889, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:29.308539 20053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:29.301518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50054 (local address 127.14.146.254:34357)
0808 21:01:29.301594 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:29.301596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:29.301679 (+ 83us) server_negotiation.cc:407] Connection header received
0808 21:01:29.301754 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:29.301755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:29.301764 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:29.301823 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:29.302355 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.302848 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.303541 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:29.303730 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:29.303778 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:29.305986 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:29.305988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:29.305988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:29.305995 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:29.307365 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:29.307662 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:29.307663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:29.307664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:29.307722 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:29.307975 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:29.307976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:29.307976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:29.308231 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:29.308323 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:29.308409 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 21:01:29.308473 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260808 21:01:29.308806 19992 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50054
I20260808 21:01:29.309231 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 20089
I20260808 21:01:29.325445 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 20297
I20260808 21:01:29.338408 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 20500
I20260808 21:01:29.351397 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 19941
2026-08-08T21:01:29Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2121 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[20720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[20720](info): set up 2 sockets
Aug 08 21:01:29 dist-test-slave-t3q3 krb5kdc[20720](info): commencing operation
krb5kdc: starting...
W20260808 21:01:30.587111 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:30 dist-test-slave-t3q3 krb5kdc[20720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:30.716885 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34267
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:34267
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:30.805684 20740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:30.805907 20740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:30.805931 20740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:30.807114 20740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:30.807155 20740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:30.807169 20740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:30.807229 20740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:30.807257 20740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:30.808804 20740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:34267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:30.809083 20740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:30.809321 20740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:30.814307 20756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:30.814332 20740 server_base.cc:1034] running on GCE node
W20260808 21:01:30.814298 20753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:30.814296 20754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:30.814759 20740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:30.815085 20740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:30.816237 20740 hybrid_clock.cc:648] HybridClock initialized: now 1786222890816216 us; error 35 us; skew 500 ppm
Aug 08 21:01:30 dist-test-slave-t3q3 krb5kdc[20720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222890, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:30.818836 20740 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:30.819284 20740 webserver.cc:460] Webserver started at http://127.14.146.254:42699/ using document root <none> and password file <none>
I20260808 21:01:30.819506 20740 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:30.819550 20740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:30.819706 20740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:30.820855 20740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "d5032f7628d54cd09dfbbf6d7f57cae3"
format_stamp: "Formatted at 2026-08-08 21:01:30 on dist-test-slave-t3q3"
server_key: "368b914f809323c7907beeba055e4255"
server_key_iv: "ff243ac904941498305bf64996955173"
server_key_version: "encryptionkey@0"
I20260808 21:01:30.821245 20740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "d5032f7628d54cd09dfbbf6d7f57cae3"
format_stamp: "Formatted at 2026-08-08 21:01:30 on dist-test-slave-t3q3"
server_key: "368b914f809323c7907beeba055e4255"
server_key_iv: "ff243ac904941498305bf64996955173"
server_key_version: "encryptionkey@0"
I20260808 21:01:30.822628 20740 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:01:30.823336 20766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:30.823514 20740 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:30.823596 20740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "d5032f7628d54cd09dfbbf6d7f57cae3"
format_stamp: "Formatted at 2026-08-08 21:01:30 on dist-test-slave-t3q3"
server_key: "368b914f809323c7907beeba055e4255"
server_key_iv: "ff243ac904941498305bf64996955173"
server_key_version: "encryptionkey@0"
I20260808 21:01:30.823650 20740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:30.836519 20740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:30.838656 20740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:30.838845 20740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:30.843086 20740 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:34267
I20260808 21:01:30.843122 20847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:34267 every 8 connection(s)
I20260808 21:01:30.843644 20740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:30.844422 20848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:30.846701 20848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3: Bootstrap starting.
I20260808 21:01:30.847313 20848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:30.847608 20848 log.cc:824] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:30.848418 20848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3: No bootstrap required, opened a new log
I20260808 21:01:30.850081 20848 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5032f7628d54cd09dfbbf6d7f57cae3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34267 } }
I20260808 21:01:30.850225 20848 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:30.850327 20848 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5032f7628d54cd09dfbbf6d7f57cae3, State: Initialized, Role: FOLLOWER
I20260808 21:01:30.850536 20848 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5032f7628d54cd09dfbbf6d7f57cae3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34267 } }
I20260808 21:01:30.850627 20848 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:30.850677 20848 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:30.850735 20848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:30.851637 20848 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5032f7628d54cd09dfbbf6d7f57cae3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34267 } }
I20260808 21:01:30.851761 20848 leader_election.cc:302] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5032f7628d54cd09dfbbf6d7f57cae3; no voters:
I20260808 21:01:30.851943 20848 leader_election.cc:288] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:30.851981 20855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:30.852192 20855 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [term 1 LEADER]: Becoming Leader. State: Replica: d5032f7628d54cd09dfbbf6d7f57cae3, State: Running, Role: LEADER
I20260808 21:01:30.852234 20848 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:30.852283 20855 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5032f7628d54cd09dfbbf6d7f57cae3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34267 } }
I20260808 21:01:30.852298 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 20740
I20260808 21:01:30.852406 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:30.852593 14923 external_mini_cluster.cc:1428] Setting key 1ca1bb65aab909edba51c4902f74687f
I20260808 21:01:30.852631 20856 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5032f7628d54cd09dfbbf6d7f57cae3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5032f7628d54cd09dfbbf6d7f57cae3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34267 } } }
I20260808 21:01:30.852702 20856 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:30.852846 20858 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5032f7628d54cd09dfbbf6d7f57cae3. Latest consensus state: current_term: 1 leader_uuid: "d5032f7628d54cd09dfbbf6d7f57cae3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5032f7628d54cd09dfbbf6d7f57cae3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34267 } } }
I20260808 21:01:30.852901 20858 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:30.853474 20867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:30.854039 20867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:30.855592 20867 catalog_manager.cc:1347] Generated new cluster ID: f45206a2b0854cac8aa6a96b47ba535d
I20260808 21:01:30.855643 20867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:01:30 dist-test-slave-t3q3 krb5kdc[20720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:30.865160 20875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:30.853281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47172 (local address 127.14.146.254:34267)
0808 21:01:30.853683 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:30.853694 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:30.853785 (+ 91us) server_negotiation.cc:407] Connection header received
0808 21:01:30.853920 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:30.853929 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:30.853988 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:30.854100 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:30.854935 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:30.856386 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:30.857468 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:30.858143 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:30.858557 (+ 414us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:30.861126 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:30.861132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:30.861132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:30.861146 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:30.863099 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:30.863509 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:30.863513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:30.863513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:30.863626 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:30.863847 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:30.863848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:30.863848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:30.864201 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:30.864735 (+ 534us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:30.864808 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 21:01:30.864947 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":104,"threads_started":1}
I20260808 21:01:30.867690 20867 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:30.868420 20867 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:30.882095 20867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5032f7628d54cd09dfbbf6d7f57cae3: Generated new TSK 0
I20260808 21:01:30.882266 20867 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:30.914788 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34267
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:30.996881 20888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:30.997097 20888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:30.997121 20888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:30.998230 20888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:30.998266 20888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:30.998292 20888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:30.999843 20888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:31.000041 20888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:31.000299 20888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:31.005354 20896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:31.005363 20897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:31.005373 20900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:31.005650 20888 server_base.cc:1034] running on GCE node
I20260808 21:01:31.005858 20888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:31.006059 20888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:31.007237 20888 hybrid_clock.cc:648] HybridClock initialized: now 1786222891007224 us; error 41 us; skew 500 ppm
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:31.009773 20888 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:31.010253 20888 webserver.cc:460] Webserver started at http://127.14.146.193:39799/ using document root <none> and password file <none>
I20260808 21:01:31.010493 20888 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:31.010556 20888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:31.010692 20888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:31.011729 20888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "01e9bbf121b946379073cf813c0ed5ea"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "b05fb69037a28148dfa6445cfeb8aa92"
server_key_iv: "9a7dfa2ca1af7c2578f4d65c5e38cb63"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.012135 20888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "01e9bbf121b946379073cf813c0ed5ea"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "b05fb69037a28148dfa6445cfeb8aa92"
server_key_iv: "9a7dfa2ca1af7c2578f4d65c5e38cb63"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.013476 20888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:31.014173 20907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.014333 20888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:31.014430 20888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "01e9bbf121b946379073cf813c0ed5ea"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "b05fb69037a28148dfa6445cfeb8aa92"
server_key_iv: "9a7dfa2ca1af7c2578f4d65c5e38cb63"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.014513 20888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:31.037456 20888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:31.039893 20888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:31.040053 20888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:31.040326 20888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:31.040648 20888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:31.040699 20888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.040732 20888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:31.040771 20888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.046913 20888 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:38973
I20260808 21:01:31.046964 21074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:38973 every 8 connection(s)
I20260808 21:01:31.047297 20888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:31.049957 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 20888
I20260808 21:01:31.050065 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:31.050240 14923 external_mini_cluster.cc:1428] Setting key 9a759cba1d88ab62f58c6e76d49280b8
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:31.057591 20875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:31.048034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:35049 (local address 127.14.146.254:34267)
0808 21:01:31.048124 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:31.048126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:31.048358 (+ 232us) server_negotiation.cc:407] Connection header received
0808 21:01:31.049286 (+ 928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:31.049288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:31.049303 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:31.049370 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:31.050088 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.050789 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.051917 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.052232 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.052311 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:31.054655 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:31.054656 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:31.054657 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:31.054663 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:31.056226 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.056627 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.056628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.056628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.056688 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.056949 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.056949 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.056950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.057065 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:31.057135 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:31.057411 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 21:01:31.057503 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 21:01:31.057789 21079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:31.048049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34267 (local address 127.14.146.193:35049)
0808 21:01:31.048235 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:31.048272 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:31.049168 (+ 896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:31.049427 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:31.049430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:31.049674 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:31.049975 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:31.049982 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.050880 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.050881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:31.051826 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:31.051829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.052320 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.052322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:31.052458 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:31.053037 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:31.053045 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:31.054541 (+ 1496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:31.056304 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:31.056311 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:31.056313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:31.056543 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:31.056756 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:31.056757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:31.056757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:31.056874 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:31.057137 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:31.057145 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:31.057282 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 21:01:31.057388 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 21:01:31.057540 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260808 21:01:31.058262 21076 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34267
I20260808 21:01:31.058354 21076 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:31.058544 21076 heartbeater.cc:511] Master 127.14.146.254:34267 requested a full tablet report, sending...
I20260808 21:01:31.059139 20794 ts_manager.cc:194] Registered new tserver with Master: 01e9bbf121b946379073cf813c0ed5ea (127.14.146.193:38973)
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:01:31.060113 20794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:35049
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:31.076362 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34267
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:31.160162 21087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:31.160369 21087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:31.160393 21087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:31.161545 21087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:31.161587 21087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:31.161612 21087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:31.163125 21087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:31.163369 21087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:31.163614 21087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:31.168751 21095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:31.168805 21093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:31.168859 21087 server_base.cc:1034] running on GCE node
W20260808 21:01:31.168789 21098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:31.169168 21087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:31.169421 21087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:31.170575 21087 hybrid_clock.cc:648] HybridClock initialized: now 1786222891170564 us; error 31 us; skew 500 ppm
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:31.173281 21087 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:31.173733 21087 webserver.cc:460] Webserver started at http://127.14.146.194:44003/ using document root <none> and password file <none>
I20260808 21:01:31.173940 21087 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:31.173980 21087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:31.174072 21087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:31.175086 21087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "89fddb417b7840678f24f12ad8b1045b"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "974d051dd228217e3029a0c1fc345348"
server_key_iv: "f3733b26b5d323e52f1fad21efca3fb5"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.175385 21087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "89fddb417b7840678f24f12ad8b1045b"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "974d051dd228217e3029a0c1fc345348"
server_key_iv: "f3733b26b5d323e52f1fad21efca3fb5"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.176784 21087 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:31.177641 21110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.177845 21087 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:31.177943 21087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "89fddb417b7840678f24f12ad8b1045b"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "974d051dd228217e3029a0c1fc345348"
server_key_iv: "f3733b26b5d323e52f1fad21efca3fb5"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.178021 21087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:31.187837 21087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:31.189759 21087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:31.189898 21087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:31.190114 21087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:31.190412 21087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:31.190465 21087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.190507 21087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:31.190532 21087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.196157 21087 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:43399
I20260808 21:01:31.196219 21291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:43399 every 8 connection(s)
I20260808 21:01:31.196547 21087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:31.201841 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 21087
I20260808 21:01:31.201969 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:31.202142 14923 external_mini_cluster.cc:1428] Setting key bd672f37f8020b541a038aebd61e7962
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:31.206645 21294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:31.197307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34267 (local address 127.14.146.194:39535)
0808 21:01:31.197494 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:31.197528 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:31.198453 (+ 925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:31.198732 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:31.198735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:31.198981 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:31.199169 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:31.199173 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.199884 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.199886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:31.200725 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:31.200727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.201124 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.201125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:31.201254 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:31.201822 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:31.201838 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:31.203491 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:31.205349 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:31.205355 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:31.205357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:31.205575 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:31.205796 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:31.205796 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:31.205797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:31.205892 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:31.206184 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:31.206188 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:31.206297 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 21:01:31.206374 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 21:01:31.206491 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":105,"threads_started":1}
I20260808 21:01:31.206668 20875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:31.197322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:39535 (local address 127.14.146.254:34267)
0808 21:01:31.197393 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:31.197395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:31.197611 (+ 216us) server_negotiation.cc:407] Connection header received
0808 21:01:31.198568 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:31.198569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:31.198582 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:31.198648 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:31.199262 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.199784 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.200814 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.201030 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.201112 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:31.203592 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:31.203594 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:31.203594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:31.203602 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:31.205252 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.205645 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.205647 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.205647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.205718 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.205956 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.205957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.205957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.206111 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:31.206182 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:31.206419 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 21:01:31.206522 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 21:01:31.207336 21292 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34267
I20260808 21:01:31.207417 21292 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:31.207589 21292 heartbeater.cc:511] Master 127.14.146.254:34267 requested a full tablet report, sending...
I20260808 21:01:31.207990 20794 ts_manager.cc:194] Registered new tserver with Master: 89fddb417b7840678f24f12ad8b1045b (127.14.146.194:43399)
I20260808 21:01:31.208375 20794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:39535
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:31.228717 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34267
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:31.311364 21299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:31.311630 21299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:31.311672 21299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:31.312927 21299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:31.313009 21299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:31.313056 21299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:31.314590 21299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34267
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:31.314855 21299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:31.315088 21299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:31.320578 21310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:31.320597 21305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:31.320639 21299 server_base.cc:1034] running on GCE node
W20260808 21:01:31.320597 21306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:31.321141 21299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:31.321385 21299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:31.322546 21299 hybrid_clock.cc:648] HybridClock initialized: now 1786222891322523 us; error 31 us; skew 500 ppm
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:31.325886 21299 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:31.326400 21299 webserver.cc:460] Webserver started at http://127.14.146.195:34923/ using document root <none> and password file <none>
I20260808 21:01:31.326651 21299 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:31.326725 21299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:31.326895 21299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:31.328143 21299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "375bd7fb806e493993d1ed03643e2c42"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "b59a4193ebccbb9bedf731010b04b14a"
server_key_iv: "0abfe63a22e03813ab827662c0b17cf4"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.328567 21299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "375bd7fb806e493993d1ed03643e2c42"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "b59a4193ebccbb9bedf731010b04b14a"
server_key_iv: "0abfe63a22e03813ab827662c0b17cf4"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.330025 21299 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:01:31.330803 21318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.330979 21299 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:31.331116 21299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "375bd7fb806e493993d1ed03643e2c42"
format_stamp: "Formatted at 2026-08-08 21:01:31 on dist-test-slave-t3q3"
server_key: "b59a4193ebccbb9bedf731010b04b14a"
server_key_iv: "0abfe63a22e03813ab827662c0b17cf4"
server_key_version: "encryptionkey@0"
I20260808 21:01:31.331198 21299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:31.368451 21299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:31.370913 21299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:31.371088 21299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:31.371351 21299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:31.371682 21299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:31.371735 21299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.371778 21299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:31.371811 21299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:31.377967 21299 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:44359
I20260808 21:01:31.378012 21503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:44359 every 8 connection(s)
I20260808 21:01:31.378376 21299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:31.384420 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 21299
I20260808 21:01:31.384542 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:31.384766 14923 external_mini_cluster.cc:1428] Setting key 9fb06bb9c1e691b1c7dd1b2b212e9b60
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:31.388350 20875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:31.379141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:38119 (local address 127.14.146.254:34267)
0808 21:01:31.379202 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:31.379204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:31.379414 (+ 210us) server_negotiation.cc:407] Connection header received
0808 21:01:31.380481 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:31.380483 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:31.380497 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:31.380563 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:31.381251 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.381778 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.382870 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.383099 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.383185 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:31.385790 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:31.385792 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:31.385792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:31.385799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:31.386935 (+ 1136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.387344 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.387346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.387346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.387410 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.387655 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.387656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.387657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.387779 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:31.387856 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:31.388175 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 21:01:31.388258 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 21:01:31.388556 21506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:31.379125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34267 (local address 127.14.146.195:38119)
0808 21:01:31.379288 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:31.379326 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:31.380373 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:31.380637 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:31.380641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:31.380939 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:31.381145 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:31.381150 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.381896 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.381898 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:31.382779 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:31.382782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.383197 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.383199 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:31.383322 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:31.383847 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:31.383855 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:31.385707 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:31.387026 (+ 1319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:31.387033 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:31.387035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:31.387257 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:31.387478 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:31.387479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:31.387479 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:31.387591 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:31.387844 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:31.387851 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:31.387993 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 21:01:31.388148 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 21:01:31.388309 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260808 21:01:31.389000 21504 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34267
I20260808 21:01:31.389107 21504 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:31.389286 21504 heartbeater.cc:511] Master 127.14.146.254:34267 requested a full tablet report, sending...
I20260808 21:01:31.389638 20794 ts_manager.cc:194] Registered new tserver with Master: 375bd7fb806e493993d1ed03643e2c42 (127.14.146.195:44359)
I20260808 21:01:31.390004 20794 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:38119
I20260808 21:01:31.396489 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:31.420435 21517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:31.412668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44786 (local address 127.14.146.193:38973)
0808 21:01:31.412878 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:31.412883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:31.412894 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:31.412922 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:31.412924 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:31.412939 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:31.413015 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:31.413565 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.414277 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.414993 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.415308 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.415362 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:31.417756 (+ 2394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:31.417765 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:31.417766 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:31.417774 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:31.419337 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.419666 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.419669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.419669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.419725 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.419884 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.419885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.419885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.420095 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:31.420224 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:31.420290 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 21:01:31.420355 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":116,"threads_started":1}
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[20720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:31.428324 20875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:31.421804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47182 (local address 127.14.146.254:34267)
0808 21:01:31.421853 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:31.421854 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:31.421865 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:31.421930 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:31.421931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:31.421941 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:31.421985 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:31.422428 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.422912 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.423560 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:31.423753 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:31.423809 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:31.425960 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:31.425961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:31.425961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:31.425968 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:31.427350 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.427651 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.427652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.427652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.427707 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:31.427854 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:31.427854 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:31.427854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:31.427987 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:31.428150 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:31.428202 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 21:01:31.428261 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 21:01:31.428572 20794 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47182
I20260808 21:01:31.428917 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 20888
I20260808 21:01:31.445487 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 21087
I20260808 21:01:31.457460 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 21299
I20260808 21:01:31.467445 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 20740
2026-08-08T21:01:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2118 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[21522](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[21522](info): set up 2 sockets
Aug 08 21:01:31 dist-test-slave-t3q3 krb5kdc[21522](info): commencing operation
krb5kdc: starting...
W20260808 21:01:32.719985 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:32 dist-test-slave-t3q3 krb5kdc[21522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:32.855564 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:46285
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:46285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:32.940834 21545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:32.941036 21545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:32.941059 21545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:32.942185 21545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:32.942226 21545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:32.942240 21545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:32.942274 21545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:32.942301 21545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:32.943766 21545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:46285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:46285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:32.944012 21545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:32.944247 21545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:32.949090 21550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:32.949090 21553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:32.949113 21551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:32.949117 21545 server_base.cc:1034] running on GCE node
I20260808 21:01:32.949558 21545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:32.949815 21545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:32.950956 21545 hybrid_clock.cc:648] HybridClock initialized: now 1786222892950934 us; error 35 us; skew 500 ppm
Aug 08 21:01:32 dist-test-slave-t3q3 krb5kdc[21522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222892, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:32.953629 21545 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:32.953933 21545 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:32.953979 21545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:32.954082 21545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:32.955093 21545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "8a3960954fd4494ca54d7f8233896fa8"
format_stamp: "Formatted at 2026-08-08 21:01:32 on dist-test-slave-t3q3"
server_key: "aff92f54a7d613a9b316ad0fd35f8448"
server_key_iv: "7d40038db680820319f28c11433969a6"
server_key_version: "encryptionkey@0"
I20260808 21:01:32.955403 21545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "8a3960954fd4494ca54d7f8233896fa8"
format_stamp: "Formatted at 2026-08-08 21:01:32 on dist-test-slave-t3q3"
server_key: "aff92f54a7d613a9b316ad0fd35f8448"
server_key_iv: "7d40038db680820319f28c11433969a6"
server_key_version: "encryptionkey@0"
I20260808 21:01:32.956735 21545 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 21:01:32.957443 21564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:32.957624 21545 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:32.957731 21545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "8a3960954fd4494ca54d7f8233896fa8"
format_stamp: "Formatted at 2026-08-08 21:01:32 on dist-test-slave-t3q3"
server_key: "aff92f54a7d613a9b316ad0fd35f8448"
server_key_iv: "7d40038db680820319f28c11433969a6"
server_key_version: "encryptionkey@0"
I20260808 21:01:32.957804 21545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:32.972304 21545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:32.974596 21545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:32.974761 21545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:32.978894 21545 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:46285
I20260808 21:01:32.978922 21647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:46285 every 8 connection(s)
I20260808 21:01:32.979223 21545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:32.980376 21648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:32.981392 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 21545
I20260808 21:01:32.981515 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:32.981704 14923 external_mini_cluster.cc:1428] Setting key 85d3057e8dfc3983993c8725f975ae62
I20260808 21:01:32.983858 21648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8: Bootstrap starting.
I20260808 21:01:32.984527 21648 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:32.984814 21648 log.cc:824] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:32.985512 21648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8: No bootstrap required, opened a new log
I20260808 21:01:32.987341 21648 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3960954fd4494ca54d7f8233896fa8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46285 } }
I20260808 21:01:32.987478 21648 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:32.987501 21648 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a3960954fd4494ca54d7f8233896fa8, State: Initialized, Role: FOLLOWER
I20260808 21:01:32.987641 21648 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3960954fd4494ca54d7f8233896fa8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46285 } }
I20260808 21:01:32.987721 21648 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:32.987746 21648 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:32.987810 21648 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 21:01:32 dist-test-slave-t3q3 krb5kdc[21522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:32.988473 21648 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3960954fd4494ca54d7f8233896fa8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46285 } }
I20260808 21:01:32.988626 21648 leader_election.cc:302] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a3960954fd4494ca54d7f8233896fa8; no voters:
I20260808 21:01:32.988831 21648 leader_election.cc:288] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:32.989004 21656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:32.989136 21648 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:32.989158 21656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [term 1 LEADER]: Becoming Leader. State: Replica: 8a3960954fd4494ca54d7f8233896fa8, State: Running, Role: LEADER
I20260808 21:01:32.989437 21656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3960954fd4494ca54d7f8233896fa8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46285 } }
I20260808 21:01:32.989861 21656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a3960954fd4494ca54d7f8233896fa8. Latest consensus state: current_term: 1 leader_uuid: "8a3960954fd4494ca54d7f8233896fa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3960954fd4494ca54d7f8233896fa8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46285 } } }
I20260808 21:01:32.989984 21659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a3960954fd4494ca54d7f8233896fa8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a3960954fd4494ca54d7f8233896fa8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46285 } } }
I20260808 21:01:32.990023 21656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:32.990093 21659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:32.990290 21666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:32.990753 21666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:32.993227 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:32.982234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48020 (local address 127.14.146.254:46285)
0808 21:01:32.982403 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:32.982411 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:32.982436 (+ 25us) server_negotiation.cc:407] Connection header received
0808 21:01:32.982854 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:32.982861 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:32.982907 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:32.983016 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:32.983817 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:32.984882 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:32.985657 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:32.986081 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:32.986203 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:32.988743 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:32.988748 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:32.988748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:32.988762 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:32.990972 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:32.991439 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:32.991443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:32.991443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:32.991558 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:32.991794 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:32.991796 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:32.991796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:32.992191 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:32.992346 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:32.992861 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 21:01:32.993033 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260808 21:01:32.993602 21666 catalog_manager.cc:1347] Generated new cluster ID: 64c7a84a85fb4bd2911941b2552ec6f5
I20260808 21:01:32.993655 21666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:33.005903 21666 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:33.006649 21666 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:33.013267 21666 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8: Generated new TSK 0
I20260808 21:01:33.013439 21666 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:33.049374 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46285
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:33.132230 21694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:33.132421 21694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:33.132444 21694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:33.133525 21694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:33.133561 21694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:33.133586 21694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:33.135063 21694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:33.135250 21694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:33.135411 21694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:33.140389 21702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:33.140393 21705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:33.140409 21701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:33.140625 21694 server_base.cc:1034] running on GCE node
I20260808 21:01:33.140843 21694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:33.141096 21694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:33.142268 21694 hybrid_clock.cc:648] HybridClock initialized: now 1786222893142252 us; error 26 us; skew 500 ppm
Aug 08 21:01:33 dist-test-slave-t3q3 krb5kdc[21522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222893, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:33.145068 21694 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:33.145406 21694 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:33.145475 21694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:33.145619 21694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:33.146648 21694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "c585f56a22ee4b4aa15727c57e467574"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "6b6c78e398f3ce5d3f0b91508d909257"
server_key_iv: "b0f8d0a7643bef01a8ddab444ee62292"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.147002 21694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "c585f56a22ee4b4aa15727c57e467574"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "6b6c78e398f3ce5d3f0b91508d909257"
server_key_iv: "b0f8d0a7643bef01a8ddab444ee62292"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.148344 21694 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:33.149049 21714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.149231 21694 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:33.149336 21694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "c585f56a22ee4b4aa15727c57e467574"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "6b6c78e398f3ce5d3f0b91508d909257"
server_key_iv: "b0f8d0a7643bef01a8ddab444ee62292"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.149408 21694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:33.176735 21694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:33.178742 21694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:33.178907 21694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:33.179169 21694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:33.179489 21694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:33.179543 21694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.179584 21694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:33.179620 21694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.185449 21694 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:40951
I20260808 21:01:33.185496 21887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:40951 every 8 connection(s)
I20260808 21:01:33.185773 21694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
Aug 08 21:01:33 dist-test-slave-t3q3 krb5kdc[21522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222893, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:33.194974 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 21694
I20260808 21:01:33.195122 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:33.195314 14923 external_mini_cluster.cc:1428] Setting key 414652c9b2d9e4771521bb7aa7bab87d
I20260808 21:01:33.195582 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.186631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:42893 (local address 127.14.146.254:46285)
0808 21:01:33.186699 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.186701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.186921 (+ 220us) server_negotiation.cc:407] Connection header received
0808 21:01:33.187466 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.187467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.187479 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.187540 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:33.188650 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.189223 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.190246 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.190482 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.190558 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.192772 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:33.192774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:33.192774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:33.192782 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:33.194103 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:33.194524 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:33.194525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:33.194525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:33.194585 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:33.194846 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:33.194847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:33.194848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:33.194968 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:33.195042 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.195380 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.195488 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 21:01:33.195734 21892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.186617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:46285 (local address 127.14.146.193:42893)
0808 21:01:33.186796 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.186833 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:33.187358 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:33.187610 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:33.187614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:33.187873 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:33.188537 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.188543 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.189316 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.189318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.190155 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.190157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.190565 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.190566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.190694 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.191224 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:33.191233 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:33.192680 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:33.194202 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:33.194210 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:33.194212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:33.194434 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:33.194668 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:33.194669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:33.194669 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:33.194779 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:33.195034 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:33.195041 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:33.195224 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 21:01:33.195345 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 21:01:33.195505 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
I20260808 21:01:33.196344 21888 heartbeater.cc:347] Connected to a master server at 127.14.146.254:46285
I20260808 21:01:33.196437 21888 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:33.196602 21888 heartbeater.cc:511] Master 127.14.146.254:46285 requested a full tablet report, sending...
I20260808 21:01:33.197180 21591 ts_manager.cc:194] Registered new tserver with Master: c585f56a22ee4b4aa15727c57e467574 (127.14.146.193:40951)
I20260808 21:01:33.197976 21591 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:42893
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:33.220921 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46285
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:33.303282 21895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:33.303541 21895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:33.303583 21895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:33.304782 21895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:33.304850 21895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:33.304896 21895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:33.306418 21895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:33.306695 21895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:33.306927 21895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:33.312033 21902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:33.312039 21906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:33.312039 21901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:33.312413 21895 server_base.cc:1034] running on GCE node
I20260808 21:01:33.312633 21895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:33.312839 21895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:33.314021 21895 hybrid_clock.cc:648] HybridClock initialized: now 1786222893314005 us; error 42 us; skew 500 ppm
Aug 08 21:01:33 dist-test-slave-t3q3 krb5kdc[21522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222893, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:33.316815 21895 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:33.317178 21895 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:33.317250 21895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:33.317395 21895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:33.318482 21895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "e1e9ae8c1ae047b2b5be283b714036f1"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "a474dd7d9fbd0658c86de6617843ca85"
server_key_iv: "ace714f6c355b73a9005408d7b2c4c51"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.318862 21895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "e1e9ae8c1ae047b2b5be283b714036f1"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "a474dd7d9fbd0658c86de6617843ca85"
server_key_iv: "ace714f6c355b73a9005408d7b2c4c51"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.320218 21895 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 21:01:33.320955 21916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.321120 21895 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:33.321241 21895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "e1e9ae8c1ae047b2b5be283b714036f1"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "a474dd7d9fbd0658c86de6617843ca85"
server_key_iv: "ace714f6c355b73a9005408d7b2c4c51"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.321313 21895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:33.333745 21895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:33.335793 21895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:33.335960 21895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:33.336251 21895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:33.336601 21895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:33.336655 21895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.336699 21895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:33.336728 21895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.342630 21895 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:46295
I20260808 21:01:33.342669 22093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:46295 every 8 connection(s)
I20260808 21:01:33.342971 21895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:33.346005 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 21895
I20260808 21:01:33.346095 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:33.346306 14923 external_mini_cluster.cc:1428] Setting key 8e5ef757b5972c72e247cc4b5269e0af
Aug 08 21:01:33 dist-test-slave-t3q3 krb5kdc[21522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222893, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:33.353467 22099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.343623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:46285 (local address 127.14.146.194:38045)
0808 21:01:33.343774 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.343818 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:33.344382 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:33.344647 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:33.344650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:33.344921 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:33.345421 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.345426 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.346243 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.346245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.347395 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.347400 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.347777 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.347779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.347936 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.348484 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:33.348495 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:33.350064 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:33.351928 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:33.351938 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:33.351940 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:33.352269 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:33.352483 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:33.352484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:33.352484 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:33.352585 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:33.352888 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:33.352893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:33.353022 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 21:01:33.353130 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 21:01:33.353301 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260808 21:01:33.353464 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.343665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:38045 (local address 127.14.146.254:46285)
0808 21:01:33.343715 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.343717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.343904 (+ 187us) server_negotiation.cc:407] Connection header received
0808 21:01:33.344488 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.344489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.344503 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.344568 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:33.345529 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.346067 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.347494 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.347697 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.347752 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.350160 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:33.350162 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:33.350162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:33.350171 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:33.351833 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:33.352344 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:33.352346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:33.352346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:33.352413 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:33.352660 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:33.352661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:33.352662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:33.352818 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:33.352896 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.353226 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.353325 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:01:33.353938 22094 heartbeater.cc:347] Connected to a master server at 127.14.146.254:46285
I20260808 21:01:33.354055 22094 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:33.354239 22094 heartbeater.cc:511] Master 127.14.146.254:46285 requested a full tablet report, sending...
I20260808 21:01:33.354626 21591 ts_manager.cc:194] Registered new tserver with Master: e1e9ae8c1ae047b2b5be283b714036f1 (127.14.146.194:46295)
I20260808 21:01:33.355010 21591 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:38045
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:33.373153 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46285
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:33.457469 22102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:33.457681 22102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:33.457706 22102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:33.458943 22102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:33.458989 22102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:33.459017 22102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:33.460651 22102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:33.460902 22102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:33.461145 22102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:33.466140 22116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:33.466207 22111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:33.466140 22112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:33.466322 22102 server_base.cc:1034] running on GCE node
I20260808 21:01:33.466609 22102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:33.466892 22102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:33.468094 22102 hybrid_clock.cc:648] HybridClock initialized: now 1786222893468041 us; error 28 us; skew 500 ppm
Aug 08 21:01:33 dist-test-slave-t3q3 krb5kdc[21522](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222893, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:33.470615 22102 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:33.471022 22102 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:33.471091 22102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:33.471242 22102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:33.472357 22102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "d7e063a2cb704334bb2a7d42b612e48a"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "977149c0f06dab072fbcaa946167f5fb"
server_key_iv: "923f96a8e13ab678f21dbc6125b25706"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.472721 22102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "d7e063a2cb704334bb2a7d42b612e48a"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "977149c0f06dab072fbcaa946167f5fb"
server_key_iv: "923f96a8e13ab678f21dbc6125b25706"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.474050 22102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:01:33.474808 22123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.474994 22102 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:33.475085 22102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "d7e063a2cb704334bb2a7d42b612e48a"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "977149c0f06dab072fbcaa946167f5fb"
server_key_iv: "923f96a8e13ab678f21dbc6125b25706"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.475162 22102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:33.496305 22102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:33.498179 22102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:33.498346 22102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:33.498589 22102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:33.498924 22102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:33.498976 22102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.499019 22102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:33.499053 22102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.505668 22102 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:33297
I20260808 21:01:33.505708 22308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:33297 every 8 connection(s)
I20260808 21:01:33.505986 22102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:33.508811 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 22102
I20260808 21:01:33.508893 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:33.509088 14923 external_mini_cluster.cc:1428] Setting key bd5b63eada47812d059680be4b4ddfd1
Aug 08 21:01:33 dist-test-slave-t3q3 krb5kdc[21522](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222893, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:33.515841 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.506690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:46615 (local address 127.14.146.254:46285)
0808 21:01:33.506743 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.506745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.506936 (+ 191us) server_negotiation.cc:407] Connection header received
0808 21:01:33.507409 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.507410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.507421 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.507474 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:33.508490 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.509069 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.510401 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.510596 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.510653 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.512842 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:33.512844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:33.512844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:33.512850 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:33.514468 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:33.514875 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:33.514876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:33.514877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:33.514938 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:33.515193 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:33.515194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:33.515194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:33.515313 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:33.515384 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.515657 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.515747 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 21:01:33.516034 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.506665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:46285 (local address 127.14.146.195:46615)
0808 21:01:33.506813 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.506849 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:33.507327 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:33.507528 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:33.507531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:33.507798 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:33.508405 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.508412 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.509176 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.509178 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.510332 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.510335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.510667 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.510667 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.510766 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.511203 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:33.511211 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:33.512727 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:33.514551 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:33.514558 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:33.514560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:33.514800 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:33.515009 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:33.515010 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:33.515010 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:33.515122 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:33.515387 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:33.515394 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:33.515530 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 21:01:33.515636 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 21:01:33.515796 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
I20260808 21:01:33.516475 22309 heartbeater.cc:347] Connected to a master server at 127.14.146.254:46285
I20260808 21:01:33.516574 22309 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:33.516731 22309 heartbeater.cc:511] Master 127.14.146.254:46285 requested a full tablet report, sending...
I20260808 21:01:33.517105 21591 ts_manager.cc:194] Registered new tserver with Master: d7e063a2cb704334bb2a7d42b612e48a (127.14.146.195:33297)
I20260808 21:01:33.517474 21591 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:46615
I20260808 21:01:33.520744 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:01:33.528230 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.522044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48028 (local address 127.14.146.254:46285)
0808 21:01:33.522081 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.522083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.522173 (+ 90us) server_negotiation.cc:407] Connection header received
0808 21:01:33.522226 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.522226 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.522235 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.522282 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:33.522911 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.523407 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.524204 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.524461 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.524520 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.525886 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:33.525887 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:33.525887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:33.525894 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:33.527144 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:33.527455 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:33.527455 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:33.527456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:33.527506 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:33.527661 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:33.527662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:33.527662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:33.527797 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:33.527876 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.528029 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.528153 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:01:33.529946 21591 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:33.531560 21591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:33.537858 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.533821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:33297 (local address 127.0.0.1:42358)
0808 21:01:33.533969 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.533999 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:33.534089 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:33.534399 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:33.534403 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:33.534405 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:33.534476 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.534477 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.535532 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.535534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.536638 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.536640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.537537 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.537538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.537617 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.537630 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 21:01:33.537725 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 21:01:33.537785 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260808 21:01:33.537870 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.533920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42358 (local address 127.14.146.195:33297)
0808 21:01:33.534100 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.534105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.534116 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:33.534191 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.534193 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.534208 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.534294 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:33.534565 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.535434 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.536747 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.537458 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.537540 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.537599 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.537744 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.537785 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":95,"threads_started":1}
I20260808 21:01:33.538385 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.534053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:46295 (local address 127.0.0.1:39102)
0808 21:01:33.534184 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.534194 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:33.534243 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:33.534697 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:33.534698 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:33.534700 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:33.534761 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.534763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.536154 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.536155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.537281 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.537284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.538165 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.538166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.538233 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.538237 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:33.538267 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 21:01:33.538308 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":25,"thread_start_us":92,"threads_started":1}
I20260808 21:01:33.538568 22337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.534485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59404 (local address 127.14.146.193:40951)
0808 21:01:33.534693 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.534697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.534707 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:33.534750 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.534752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.534767 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.534841 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:33.535063 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.536137 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.537333 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.538057 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.538137 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.538194 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.538434 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.538483 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":129,"threads_started":1}
I20260808 21:01:33.538496 22330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.534245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:40951 (local address 127.0.0.1:59404)
0808 21:01:33.534344 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.534355 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:33.534397 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:33.534936 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:33.534937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:33.534939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:33.534982 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.534984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.536218 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.536219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.537254 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.537257 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.538235 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.538236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.538289 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.538291 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:33.538336 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 21:01:33.538365 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"mutex_wait_us":33,"thread_start_us":69,"threads_started":1}
I20260808 21:01:33.538902 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.534339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39102 (local address 127.14.146.194:46295)
0808 21:01:33.534526 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.534531 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.534540 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:33.534578 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.534580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.534594 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.534842 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:33.534926 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.536036 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.537376 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.538065 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.538702 (+ 637us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.538771 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.538792 (+ 21us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.538824 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":82,"threads_started":1}
I20260808 21:01:33.538803 22209 tablet_service.cc:1467] Processing CreateTablet for tablet 228af47f3b2d4fe5810f2fff4a59fe14 (DEFAULT_TABLE table=test-table [id=f7d749cd7ef64eccad9717ff1ba70fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:33.539208 22209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228af47f3b2d4fe5810f2fff4a59fe14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:33.539594 21988 tablet_service.cc:1467] Processing CreateTablet for tablet 228af47f3b2d4fe5810f2fff4a59fe14 (DEFAULT_TABLE table=test-table [id=f7d749cd7ef64eccad9717ff1ba70fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:33.539580 21786 tablet_service.cc:1467] Processing CreateTablet for tablet 228af47f3b2d4fe5810f2fff4a59fe14 (DEFAULT_TABLE table=test-table [id=f7d749cd7ef64eccad9717ff1ba70fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:33.539899 21786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228af47f3b2d4fe5810f2fff4a59fe14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:33.539927 21988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 228af47f3b2d4fe5810f2fff4a59fe14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:33.542629 22340 tablet_bootstrap.cc:492] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Bootstrap starting.
I20260808 21:01:33.543251 22340 tablet_bootstrap.cc:654] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:33.543247 22343 tablet_bootstrap.cc:492] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574: Bootstrap starting.
I20260808 21:01:33.543449 22342 tablet_bootstrap.cc:492] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Bootstrap starting.
I20260808 21:01:33.543872 22340 log.cc:824] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:33.543969 22343 tablet_bootstrap.cc:654] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:33.544168 22342 tablet_bootstrap.cc:654] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:33.544624 22340 tablet_bootstrap.cc:492] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: No bootstrap required, opened a new log
I20260808 21:01:33.544706 22340 ts_tablet_manager.cc:1397] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260808 21:01:33.544692 22343 log.cc:824] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:33.544795 22342 log.cc:824] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:33.545461 22343 tablet_bootstrap.cc:492] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574: No bootstrap required, opened a new log
I20260808 21:01:33.545534 22343 ts_tablet_manager.cc:1397] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:33.546375 22340 raft_consensus.cc:348] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.546512 22340 raft_consensus.cc:374] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:33.546535 22340 raft_consensus.cc:729] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1e9ae8c1ae047b2b5be283b714036f1, State: Initialized, Role: FOLLOWER
I20260808 21:01:33.546687 22340 consensus_queue.cc:260] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.546970 22340 ts_tablet_manager.cc:1428] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:01:33.547034 22094 heartbeater.cc:503] Master 127.14.146.254:46285 was elected leader, sending a full tablet report...
I20260808 21:01:33.547176 22343 raft_consensus.cc:348] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.547326 22343 raft_consensus.cc:374] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:33.547370 22343 raft_consensus.cc:729] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c585f56a22ee4b4aa15727c57e467574, State: Initialized, Role: FOLLOWER
I20260808 21:01:33.547479 22343 consensus_queue.cc:260] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.547760 22343 ts_tablet_manager.cc:1428] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:33.547781 21888 heartbeater.cc:503] Master 127.14.146.254:46285 was elected leader, sending a full tablet report...
I20260808 21:01:33.548223 22342 tablet_bootstrap.cc:492] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: No bootstrap required, opened a new log
I20260808 21:01:33.548352 22342 ts_tablet_manager.cc:1397] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260808 21:01:33.549898 22342 raft_consensus.cc:348] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.550019 22342 raft_consensus.cc:374] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:33.550040 22342 raft_consensus.cc:729] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e063a2cb704334bb2a7d42b612e48a, State: Initialized, Role: FOLLOWER
I20260808 21:01:33.550176 22342 consensus_queue.cc:260] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.550436 22342 ts_tablet_manager.cc:1428] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260808 21:01:33.550463 22309 heartbeater.cc:503] Master 127.14.146.254:46285 was elected leader, sending a full tablet report...
W20260808 21:01:33.593597 22096 tablet.cc:2369] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:01:33.686472 21889 tablet.cc:2369] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:33.719323 22347 raft_consensus.cc:482] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:33.719455 22347 raft_consensus.cc:504] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.719894 22347 leader_election.cc:288] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e063a2cb704334bb2a7d42b612e48a (127.14.146.195:33297), c585f56a22ee4b4aa15727c57e467574 (127.14.146.193:40951)
I20260808 21:01:33.723819 22328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.720258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:53625 (local address 127.14.146.195:33297)
0808 21:01:33.720321 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.720323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.720334 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:33.720434 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.720435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.720451 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.720506 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:33.720709 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.721354 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.722854 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.723420 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.723495 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.723503 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.723702 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.723742 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:01:33.723860 22337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.720404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:37413 (local address 127.14.146.193:40951)
0808 21:01:33.720456 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.720458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.720579 (+ 121us) server_negotiation.cc:407] Connection header received
0808 21:01:33.720618 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.720619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.720629 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.720694 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:33.720868 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.721483 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.722854 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.723420 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.723470 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.723481 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.723742 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.723796 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:01:33.723846 22099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.720203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:33297 (local address 127.14.146.194:53625)
0808 21:01:33.720255 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.720266 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:33.720344 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:33.720524 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:33.720525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:33.720527 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:33.720625 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.720627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.721433 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.721434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.722766 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.722768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.723496 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.723497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.723620 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.723624 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:33.723695 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 21:01:33.723743 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":17}
I20260808 21:01:33.723855 22353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.720325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:40951 (local address 127.14.146.194:37413)
0808 21:01:33.720499 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.720511 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:33.720570 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:33.720708 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:33.720709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:33.720711 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:33.720782 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.720783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.721552 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.721553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.722742 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:33.722745 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.723544 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.723545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:33.723659 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.723662 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:33.723710 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 21:01:33.723748 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":20,"thread_start_us":117,"threads_started":1}
I20260808 21:01:33.724272 22238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228af47f3b2d4fe5810f2fff4a59fe14" candidate_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e063a2cb704334bb2a7d42b612e48a" is_pre_election: true
I20260808 21:01:33.724347 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228af47f3b2d4fe5810f2fff4a59fe14" candidate_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c585f56a22ee4b4aa15727c57e467574" is_pre_election: true
I20260808 21:01:33.724447 22238 raft_consensus.cc:2454] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e9ae8c1ae047b2b5be283b714036f1 in term 0.
I20260808 21:01:33.724486 21816 raft_consensus.cc:2454] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1e9ae8c1ae047b2b5be283b714036f1 in term 0.
I20260808 21:01:33.724675 21922 leader_election.cc:302] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7e063a2cb704334bb2a7d42b612e48a, e1e9ae8c1ae047b2b5be283b714036f1; no voters:
I20260808 21:01:33.724820 22347 raft_consensus.cc:2781] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:33.724900 22347 raft_consensus.cc:482] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:33.724936 22347 raft_consensus.cc:3037] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:33.725672 22347 raft_consensus.cc:504] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.725819 22347 leader_election.cc:288] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [CANDIDATE]: Term 1 election: Requested vote from peers d7e063a2cb704334bb2a7d42b612e48a (127.14.146.195:33297), c585f56a22ee4b4aa15727c57e467574 (127.14.146.193:40951)
I20260808 21:01:33.725956 22238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228af47f3b2d4fe5810f2fff4a59fe14" candidate_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e063a2cb704334bb2a7d42b612e48a"
I20260808 21:01:33.726008 21816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "228af47f3b2d4fe5810f2fff4a59fe14" candidate_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c585f56a22ee4b4aa15727c57e467574"
I20260808 21:01:33.726053 22238 raft_consensus.cc:3037] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:33.726079 21816 raft_consensus.cc:3037] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:33.726994 21816 raft_consensus.cc:2454] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e9ae8c1ae047b2b5be283b714036f1 in term 1.
I20260808 21:01:33.726994 22238 raft_consensus.cc:2454] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1e9ae8c1ae047b2b5be283b714036f1 in term 1.
I20260808 21:01:33.727159 21922 leader_election.cc:302] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c585f56a22ee4b4aa15727c57e467574, e1e9ae8c1ae047b2b5be283b714036f1; no voters:
I20260808 21:01:33.727290 22347 raft_consensus.cc:2781] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:33.727440 22347 raft_consensus.cc:686] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 1 LEADER]: Becoming Leader. State: Replica: e1e9ae8c1ae047b2b5be283b714036f1, State: Running, Role: LEADER
I20260808 21:01:33.727543 22347 consensus_queue.cc:237] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } }
I20260808 21:01:33.728436 21590 catalog_manager.cc:5495] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1e9ae8c1ae047b2b5be283b714036f1 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1e9ae8c1ae047b2b5be283b714036f1" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 46295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 } health_report { overall_health: UNKNOWN } } }
W20260808 21:01:33.756521 22310 tablet.cc:2369] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:33.763803 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.761358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39114 (local address 127.14.146.194:46295)
0808 21:01:33.761411 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.761414 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.761426 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:01:33.761459 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.761460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.761492 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.761569 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:33.761727 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.762210 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.762978 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:33.763183 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:33.763261 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:33.763437 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:33.763542 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:33.763634 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.763660 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.763680 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 21:01:33.765734 21816 raft_consensus.cc:1261] T 228af47f3b2d4fe5810f2fff4a59fe14 P c585f56a22ee4b4aa15727c57e467574 [term 1 FOLLOWER]: Refusing update from remote peer e1e9ae8c1ae047b2b5be283b714036f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:33.765734 22238 raft_consensus.cc:1261] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 1 FOLLOWER]: Refusing update from remote peer e1e9ae8c1ae047b2b5be283b714036f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:33.766130 22354 consensus_queue.cc:1035] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c585f56a22ee4b4aa15727c57e467574" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 40951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:33.766259 22347 consensus_queue.cc:1035] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e063a2cb704334bb2a7d42b612e48a" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 33297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:33.768718 22359 mvcc.cc:205] Tried to move back new op lower bound from 7316368972861415424 to 7316368972708663296. Current Snapshot: MvccSnapshot[applied={T|T < 7316368972861415424}]
I20260808 21:01:33.771257 21591 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:33.771347 21591 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:33.772105 21591 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8a3960954fd4494ca54d7f8233896fa8: Sending DeleteTablet for 3 replicas of tablet 228af47f3b2d4fe5810f2fff4a59fe14
I20260808 21:01:33.772524 21988 tablet_service.cc:1514] Processing DeleteTablet for tablet 228af47f3b2d4fe5810f2fff4a59fe14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:33 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:39102
I20260808 21:01:33.772547 22209 tablet_service.cc:1514] Processing DeleteTablet for tablet 228af47f3b2d4fe5810f2fff4a59fe14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:33 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:42358
I20260808 21:01:33.772755 22369 tablet_replica.cc:330] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: stopping tablet replica
I20260808 21:01:33.772758 21786 tablet_service.cc:1514] Processing DeleteTablet for tablet 228af47f3b2d4fe5810f2fff4a59fe14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:33 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:59404
I20260808 21:01:33.772857 22369 raft_consensus.cc:2229] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:33.772953 22369 raft_consensus.cc:2258] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:33.773094 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 21694
I20260808 21:01:33.782884 22369 ts_tablet_manager.cc:1905] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:33.784245 22371 tablet_replica.cc:330] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: stopping tablet replica
I20260808 21:01:33.784499 22371 raft_consensus.cc:2229] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:33.784729 22371 raft_consensus.cc:2258] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:33.784870 22369 ts_tablet_manager.cc:1918] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:33.785018 22369 log.cc:1196] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/228af47f3b2d4fe5810f2fff4a59fe14
I20260808 21:01:33.785369 22371 ts_tablet_manager.cc:1905] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:33.785435 22369 ts_tablet_manager.cc:1939] T 228af47f3b2d4fe5810f2fff4a59fe14 P e1e9ae8c1ae047b2b5be283b714036f1: Deleting consensus metadata
I20260808 21:01:33.785995 21569 catalog_manager.cc:4841] TS e1e9ae8c1ae047b2b5be283b714036f1 (127.14.146.194:46295): tablet 228af47f3b2d4fe5810f2fff4a59fe14 (table test-table [id=f7d749cd7ef64eccad9717ff1ba70fad]) successfully deleted
I20260808 21:01:33.786840 22371 ts_tablet_manager.cc:1918] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:33.786945 22371 log.cc:1196] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/228af47f3b2d4fe5810f2fff4a59fe14
I20260808 21:01:33.787243 22371 ts_tablet_manager.cc:1939] T 228af47f3b2d4fe5810f2fff4a59fe14 P d7e063a2cb704334bb2a7d42b612e48a: Deleting consensus metadata
I20260808 21:01:33.787676 21569 catalog_manager.cc:4841] TS d7e063a2cb704334bb2a7d42b612e48a (127.14.146.195:33297): tablet 228af47f3b2d4fe5810f2fff4a59fe14 (table test-table [id=f7d749cd7ef64eccad9717ff1ba70fad]) successfully deleted
W20260808 21:01:33.788486 21569 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:40951 (error 108)
I20260808 21:01:33.788697 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 21895
I20260808 21:01:33.789076 22330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.788954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:40951 (local address 127.0.0.1:59418)
0808 21:01:33.789002 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:33.789034 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:40951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 21:01:33.789186 21569 catalog_manager.cc:4584] TS c585f56a22ee4b4aa15727c57e467574 (127.14.146.193:40951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 228af47f3b2d4fe5810f2fff4a59fe14: Network error: Client connection negotiation failed: client connection to 127.14.146.193:40951: connect: Connection refused (error 111)
I20260808 21:01:33.801888 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 22102
I20260808 21:01:33.813126 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 21545
2026-08-08T21:01:33Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2343 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T21:01:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:33Z Disabled control of system clock
I20260808 21:01:33.848403 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:36671
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:36671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 21:01:33.933177 22385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:33.933400 22385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:33.933423 22385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:33.934789 22385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:33.934846 22385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:33.934929 22385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:33.934958 22385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:33.935014 22385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:33.936570 22385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:36671
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:36671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:33.936856 22385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:33.937186 22385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:33.942302 22394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:33.942340 22397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:33.942559 22385 server_base.cc:1034] running on GCE node
W20260808 21:01:33.942314 22395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:33.942874 22385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:33.943140 22385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:33.944284 22385 hybrid_clock.cc:648] HybridClock initialized: now 1786222893944271 us; error 34 us; skew 500 ppm
I20260808 21:01:33.948383 22385 webserver.cc:460] Webserver started at http://127.14.146.254:39763/ using document root <none> and password file <none>
I20260808 21:01:33.948659 22385 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:33.948709 22385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:33.948877 22385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:33.950008 22385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "17e847257fbd492d92dc9454956e3e26"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "b0b5cb0951f76023add01e2ab073fcf5"
server_key_iv: "970f864608eddd60a062f2ae8fbd8fa1"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.950392 22385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "17e847257fbd492d92dc9454956e3e26"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "b0b5cb0951f76023add01e2ab073fcf5"
server_key_iv: "970f864608eddd60a062f2ae8fbd8fa1"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.951749 22385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:33.952618 22410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:33.952845 22385 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:33.952951 22385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "17e847257fbd492d92dc9454956e3e26"
format_stamp: "Formatted at 2026-08-08 21:01:33 on dist-test-slave-t3q3"
server_key: "b0b5cb0951f76023add01e2ab073fcf5"
server_key_iv: "970f864608eddd60a062f2ae8fbd8fa1"
server_key_version: "encryptionkey@0"
I20260808 21:01:33.953045 22385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:33.956425 22385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:33.956705 22385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:33.956849 22385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:33.960827 22385 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:36671
I20260808 21:01:33.960863 22480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:36671 every 8 connection(s)
I20260808 21:01:33.961193 22385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:33.961866 22481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:33.963179 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 22385
I20260808 21:01:33.963301 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:33.963487 14923 external_mini_cluster.cc:1428] Setting key 9a9fe1237bdd4a0987fa34009a59d6df
I20260808 21:01:33.965653 22481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26: Bootstrap starting.
I20260808 21:01:33.965988 22486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:33.964040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41672 (local address 127.14.146.254:36671)
0808 21:01:33.964256 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:33.964263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:33.964288 (+ 25us) server_negotiation.cc:407] Connection header received
0808 21:01:33.964713 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:33.964719 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:33.964759 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:33.964872 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:33.965567 (+ 695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:33.965570 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:33.965570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:33.965574 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:33.965613 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:33.965629 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:33.965684 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:33.965782 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 21:01:33.965845 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":73,"threads_started":1}
I20260808 21:01:33.966452 22481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:33.966797 22481 log.cc:824] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:33.967492 22481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26: No bootstrap required, opened a new log
I20260808 21:01:33.968943 22481 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e847257fbd492d92dc9454956e3e26" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36671 } }
I20260808 21:01:33.969094 22481 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:33.969135 22481 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17e847257fbd492d92dc9454956e3e26, State: Initialized, Role: FOLLOWER
I20260808 21:01:33.969265 22481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e847257fbd492d92dc9454956e3e26" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36671 } }
I20260808 21:01:33.969341 22481 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:33.969388 22481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:33.969441 22481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:33.969977 22481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e847257fbd492d92dc9454956e3e26" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36671 } }
I20260808 21:01:33.970088 22481 leader_election.cc:302] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17e847257fbd492d92dc9454956e3e26; no voters:
I20260808 21:01:33.970269 22481 leader_election.cc:288] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:33.970538 22488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:33.970543 22481 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:33.970702 22488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [term 1 LEADER]: Becoming Leader. State: Replica: 17e847257fbd492d92dc9454956e3e26, State: Running, Role: LEADER
I20260808 21:01:33.970860 22488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e847257fbd492d92dc9454956e3e26" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36671 } }
I20260808 21:01:33.971284 22489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17e847257fbd492d92dc9454956e3e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e847257fbd492d92dc9454956e3e26" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36671 } } }
I20260808 21:01:33.971266 22491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17e847257fbd492d92dc9454956e3e26. Latest consensus state: current_term: 1 leader_uuid: "17e847257fbd492d92dc9454956e3e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e847257fbd492d92dc9454956e3e26" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36671 } } }
I20260808 21:01:33.971501 22489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:33.971513 22491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:33.971716 22501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:33.972265 22501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:33.973867 22501 catalog_manager.cc:1347] Generated new cluster ID: f3adb05faf5f4ae5bda1fe23543b272b
I20260808 21:01:33.973922 22501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:33.982128 22501 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:33.982336 22501 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:33.987180 22501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26: Generated new TSK 0
I20260808 21:01:33.987385 22501 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:01:33.992040 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36671
--builtin_ntp_servers=127.14.146.212:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 21:01:34.089689 22518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:34.089920 22518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:34.089956 22518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:34.091125 22518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:34.091187 22518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:34.091229 22518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:34.092640 22518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:34.092893 22518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:34.093197 22518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:34.098276 22526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:34.098295 22530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:34.098282 22527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:34.098510 22518 server_base.cc:1034] running on GCE node
I20260808 21:01:34.098728 22518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:34.098968 22518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:34.100131 22518 hybrid_clock.cc:648] HybridClock initialized: now 1786222894100113 us; error 31 us; skew 500 ppm
I20260808 21:01:34.101570 22518 webserver.cc:460] Webserver started at http://127.14.146.193:34115/ using document root <none> and password file <none>
I20260808 21:01:34.101827 22518 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:34.101884 22518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:34.102005 22518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:34.103387 22518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "81569c8465fc448f9254cd440c605685"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "7479c8026a830287450be279d540e3a4"
server_key_iv: "389cd9d1edf161c0634e7b2ab5e9b290"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.103806 22518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "81569c8465fc448f9254cd440c605685"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "7479c8026a830287450be279d540e3a4"
server_key_iv: "389cd9d1edf161c0634e7b2ab5e9b290"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.105490 22518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260808 21:01:34.106413 22538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.106616 22518 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:34.106716 22518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "81569c8465fc448f9254cd440c605685"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "7479c8026a830287450be279d540e3a4"
server_key_iv: "389cd9d1edf161c0634e7b2ab5e9b290"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.106791 22518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:34.111846 22518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:34.112138 22518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:34.112267 22518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:34.112471 22518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:34.112782 22518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:34.112820 22518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.112845 22518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:34.112864 22518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.119868 22518 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:44835
I20260808 21:01:34.119939 22697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:44835 every 8 connection(s)
I20260808 21:01:34.120286 22518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:34.123389 22486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.121108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:40717 (local address 127.14.146.254:36671)
0808 21:01:34.121160 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.121162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.121423 (+ 261us) server_negotiation.cc:407] Connection header received
0808 21:01:34.121898 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.121900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.121907 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.122003 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.123189 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.123190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.123190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.123195 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.123209 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.123213 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.123259 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.123322 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.123336 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 21:01:34.123733 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.121088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:36671 (local address 127.14.146.193:40717)
0808 21:01:34.121283 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.121324 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.121793 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.122053 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.122056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.122065 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:34.123047 (+ 982us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:01:34.123048 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:34.123075 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:01:34.123106 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:34.123260 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:34.123263 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:34.123265 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:34.123317 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 21:01:34.123363 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
I20260808 21:01:34.124241 22699 heartbeater.cc:347] Connected to a master server at 127.14.146.254:36671
I20260808 21:01:34.124332 22699 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:34.124452 22699 heartbeater.cc:511] Master 127.14.146.254:36671 requested a full tablet report, sending...
I20260808 21:01:34.124897 22431 ts_manager.cc:194] Registered new tserver with Master: 81569c8465fc448f9254cd440c605685 (127.14.146.193:44835)
I20260808 21:01:34.129563 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 22518
I20260808 21:01:34.129639 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:34.129788 14923 external_mini_cluster.cc:1428] Setting key 5e53e22840a928ad6f21c853ff6ac98e
I20260808 21:01:34.130686 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36671
--builtin_ntp_servers=127.14.146.212:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 21:01:34.215283 22702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:34.215533 22702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:34.215575 22702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:34.216720 22702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:34.216781 22702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:34.216826 22702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:34.218180 22702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:34.218444 22702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:34.218745 22702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:34.223939 22713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:34.223999 22709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:34.224020 22710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:34.224130 22702 server_base.cc:1034] running on GCE node
I20260808 21:01:34.224444 22702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:34.224686 22702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:34.225821 22702 hybrid_clock.cc:648] HybridClock initialized: now 1786222894225791 us; error 46 us; skew 500 ppm
I20260808 21:01:34.227043 22702 webserver.cc:460] Webserver started at http://127.14.146.194:39887/ using document root <none> and password file <none>
I20260808 21:01:34.227316 22702 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:34.227365 22702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:34.227535 22702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:34.228719 22702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "3ccac0a50f924da688c790b7c3abbc0a"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "92963f8e4f73581c213c6f2be4845ad5"
server_key_iv: "0faf2bee9497455cc038f0f38e8ec5dd"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.229080 22702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "3ccac0a50f924da688c790b7c3abbc0a"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "92963f8e4f73581c213c6f2be4845ad5"
server_key_iv: "0faf2bee9497455cc038f0f38e8ec5dd"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.230396 22702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 21:01:34.231108 22721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.231282 22702 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:34.231374 22702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "3ccac0a50f924da688c790b7c3abbc0a"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "92963f8e4f73581c213c6f2be4845ad5"
server_key_iv: "0faf2bee9497455cc038f0f38e8ec5dd"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.231444 22702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:34.234840 22702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:34.235100 22702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:34.235244 22702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:34.235440 22702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:34.235749 22702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:34.235817 22702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.235852 22702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:34.235878 22702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.241561 22702 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:36353
I20260808 21:01:34.241632 22896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:36353 every 8 connection(s)
I20260808 21:01:34.241958 22702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:34.244988 22486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.242676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:48157 (local address 127.14.146.254:36671)
0808 21:01:34.242737 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.242739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.242952 (+ 213us) server_negotiation.cc:407] Connection header received
0808 21:01:34.243465 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.243466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.243474 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.243526 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.244719 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.244721 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.244721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.244726 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.244742 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.244747 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.244813 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.244899 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.244916 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 21:01:34.245188 22902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.242673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:36671 (local address 127.14.146.194:48157)
0808 21:01:34.242839 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.242872 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.243350 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.243593 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.243602 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.243610 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:34.244549 (+ 939us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:01:34.244549 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:34.244577 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:01:34.244605 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:34.244811 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:34.244818 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:34.244821 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:34.244910 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 21:01:34.244974 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
I20260808 21:01:34.245616 22897 heartbeater.cc:347] Connected to a master server at 127.14.146.254:36671
I20260808 21:01:34.245702 22897 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:34.245862 22897 heartbeater.cc:511] Master 127.14.146.254:36671 requested a full tablet report, sending...
I20260808 21:01:34.246116 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 22702
I20260808 21:01:34.246256 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:34.246294 22431 ts_manager.cc:194] Registered new tserver with Master: 3ccac0a50f924da688c790b7c3abbc0a (127.14.146.194:36353)
I20260808 21:01:34.246408 14923 external_mini_cluster.cc:1428] Setting key b8bc15a4655972360b164501ceae70ff
I20260808 21:01:34.247411 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36671
--builtin_ntp_servers=127.14.146.212:34573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 21:01:34.331434 22903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:34.331645 22903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:34.331666 22903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:34.332867 22903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:34.332911 22903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:34.332937 22903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:34.334367 22903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:34.334597 22903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:34.334898 22903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:34.339849 22909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:34.340029 22903 server_base.cc:1034] running on GCE node
W20260808 21:01:34.339851 22913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:34.339867 22916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:34.340399 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:34.340654 22903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:34.341797 22903 hybrid_clock.cc:648] HybridClock initialized: now 1786222894341778 us; error 34 us; skew 500 ppm
I20260808 21:01:34.343096 22903 webserver.cc:460] Webserver started at http://127.14.146.195:36241/ using document root <none> and password file <none>
I20260808 21:01:34.343326 22903 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:34.343372 22903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:34.343520 22903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:34.344643 22903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "be451bcd20e34cd0a7e14ac5450c25dd"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "2a2dc7abdec9e8d4decb00c8a99e4b30"
server_key_iv: "17396366509a54c97f35a38f91a13ac3"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.345043 22903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "be451bcd20e34cd0a7e14ac5450c25dd"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "2a2dc7abdec9e8d4decb00c8a99e4b30"
server_key_iv: "17396366509a54c97f35a38f91a13ac3"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.346342 22903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:01:34.347036 22923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.347198 22903 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:34.347299 22903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "be451bcd20e34cd0a7e14ac5450c25dd"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "2a2dc7abdec9e8d4decb00c8a99e4b30"
server_key_iv: "17396366509a54c97f35a38f91a13ac3"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.347373 22903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:34.350734 22903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:34.350979 22903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:34.351123 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:34.351320 22903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:34.351624 22903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:34.351675 22903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.351714 22903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:34.351742 22903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.357715 22903 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:40153
I20260808 21:01:34.357759 23093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:40153 every 8 connection(s)
I20260808 21:01:34.358058 22903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:34.361228 22486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.358716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:51765 (local address 127.14.146.254:36671)
0808 21:01:34.358773 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.358775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.359010 (+ 235us) server_negotiation.cc:407] Connection header received
0808 21:01:34.359504 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.359505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.359512 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.359564 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.360962 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.360963 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.360963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.360968 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.360983 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.360988 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.361037 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.361139 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.361155 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 21:01:34.361419 23098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.358724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:36671 (local address 127.14.146.195:51765)
0808 21:01:34.358904 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.358935 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.359390 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.359627 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.359631 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.359645 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:34.360789 (+ 1144us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:01:34.360789 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:34.360817 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:01:34.360846 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:34.361051 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:34.361057 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:34.361060 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:34.361149 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 21:01:34.361209 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
I20260808 21:01:34.361871 23095 heartbeater.cc:347] Connected to a master server at 127.14.146.254:36671
I20260808 21:01:34.361966 23095 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:34.362124 23095 heartbeater.cc:511] Master 127.14.146.254:36671 requested a full tablet report, sending...
I20260808 21:01:34.362470 22431 ts_manager.cc:194] Registered new tserver with Master: be451bcd20e34cd0a7e14ac5450c25dd (127.14.146.195:40153)
I20260808 21:01:34.362893 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 22903
I20260808 21:01:34.363005 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:34.363188 14923 external_mini_cluster.cc:1428] Setting key 0007ed81f4e3c2fef4e12ae283b4611a
I20260808 21:01:34.363900 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:01:34.366292 22486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.365236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41684 (local address 127.14.146.254:36671)
0808 21:01:34.365285 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.365287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.365433 (+ 146us) server_negotiation.cc:407] Connection header received
0808 21:01:34.365471 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.365471 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.365475 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.365532 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.366114 (+ 582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.366115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.366115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.366118 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.366131 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.366135 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.366181 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.366235 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.366245 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 21:01:34.367702 22431 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:34.369288 22431 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:34.373024 23110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.371391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44835 (local address 127.0.0.1:52442)
0808 21:01:34.371702 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.371754 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.371805 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.372015 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.372022 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.372028 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:34.372543 (+ 515us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:01:34.372544 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:34.372560 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:01:34.372587 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:34.372836 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:34.372842 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:34.372845 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:34.372929 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 21:01:34.372944 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":96,"threads_started":1}
I20260808 21:01:34.373272 23112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.371625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52442 (local address 127.14.146.193:44835)
0808 21:01:34.371835 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.371840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.371852 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:01:34.371883 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.371885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.371896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.372005 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.372676 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.372687 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.372687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.372692 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.372728 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.372756 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.372841 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.373142 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.373163 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":119,"threads_started":1}
I20260808 21:01:34.373414 23106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.371580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:36353 (local address 127.0.0.1:34818)
0808 21:01:34.371852 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.371863 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.371970 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.372422 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.372423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.372425 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:34.372833 (+ 408us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:01:34.372833 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:34.372840 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:01:34.372855 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:34.373259 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:34.373262 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:34.373262 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 21:01:34.373318 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 21:01:34.373331 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":62,"threads_started":1}
I20260808 21:01:34.373780 23105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.371366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:40153 (local address 127.0.0.1:35264)
0808 21:01:34.371488 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.371527 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.371588 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.372979 (+ 1391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.372980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.372982 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:34.373403 (+ 421us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:01:34.373404 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:34.373409 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:01:34.373421 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:34.373670 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:34.373671 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:34.373672 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 21:01:34.373705 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 21:01:34.373718 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":69,"threads_started":1}
I20260808 21:01:34.373799 23113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.371780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34818 (local address 127.14.146.194:36353)
0808 21:01:34.371940 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.371944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.371953 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:34.372076 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.372088 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.372098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.372169 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.372935 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.372944 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.372944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.372948 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.372981 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.373017 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.373084 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.373692 (+ 608us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.373709 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
I20260808 21:01:34.374050 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.371444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35264 (local address 127.14.146.195:40153)
0808 21:01:34.372653 (+ 1209us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.372657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.372667 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:34.372690 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.372692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.372701 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.372972 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.373502 (+ 530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.373509 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.373509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.373513 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.373547 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.373567 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.373899 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.373928 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.373946 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1173,"thread_start_us":83,"threads_started":1}
I20260808 21:01:34.374068 22603 tablet_service.cc:1467] Processing CreateTablet for tablet 04198e91a8fa404b98cc55a06b09ea47 (DEFAULT_TABLE table=test-table [id=1a04061ddcb44f0bb3081903e0cbcc9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:34.374387 22801 tablet_service.cc:1467] Processing CreateTablet for tablet 04198e91a8fa404b98cc55a06b09ea47 (DEFAULT_TABLE table=test-table [id=1a04061ddcb44f0bb3081903e0cbcc9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:34.374505 22603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04198e91a8fa404b98cc55a06b09ea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:34.374727 22801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04198e91a8fa404b98cc55a06b09ea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:34.374672 22992 tablet_service.cc:1467] Processing CreateTablet for tablet 04198e91a8fa404b98cc55a06b09ea47 (DEFAULT_TABLE table=test-table [id=1a04061ddcb44f0bb3081903e0cbcc9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:34.374923 22992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04198e91a8fa404b98cc55a06b09ea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:34.377394 23115 tablet_bootstrap.cc:492] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: Bootstrap starting.
I20260808 21:01:34.378108 23115 tablet_bootstrap.cc:654] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:34.378165 23120 tablet_bootstrap.cc:492] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: Bootstrap starting.
I20260808 21:01:34.378427 23115 log.cc:824] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:34.378820 23120 tablet_bootstrap.cc:654] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:34.379112 23120 log.cc:824] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:34.379215 23115 tablet_bootstrap.cc:492] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: No bootstrap required, opened a new log
I20260808 21:01:34.379285 23115 ts_tablet_manager.cc:1397] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:34.379469 23118 tablet_bootstrap.cc:492] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685: Bootstrap starting.
I20260808 21:01:34.379851 23120 tablet_bootstrap.cc:492] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: No bootstrap required, opened a new log
I20260808 21:01:34.379930 23120 ts_tablet_manager.cc:1397] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:34.380673 23118 tablet_bootstrap.cc:654] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:34.381008 23118 log.cc:824] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:34.381668 23115 raft_consensus.cc:348] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.381817 23115 raft_consensus.cc:374] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:34.381858 23118 tablet_bootstrap.cc:492] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685: No bootstrap required, opened a new log
I20260808 21:01:34.381880 23115 raft_consensus.cc:729] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be451bcd20e34cd0a7e14ac5450c25dd, State: Initialized, Role: FOLLOWER
I20260808 21:01:34.381992 23118 ts_tablet_manager.cc:1397] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 21:01:34.382017 23115 consensus_queue.cc:260] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.382311 23095 heartbeater.cc:503] Master 127.14.146.254:36671 was elected leader, sending a full tablet report...
I20260808 21:01:34.382309 23115 ts_tablet_manager.cc:1428] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:01:34.382630 23120 raft_consensus.cc:348] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.382956 23120 raft_consensus.cc:374] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:34.383021 23120 raft_consensus.cc:729] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ccac0a50f924da688c790b7c3abbc0a, State: Initialized, Role: FOLLOWER
I20260808 21:01:34.383129 23120 consensus_queue.cc:260] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.383471 23120 ts_tablet_manager.cc:1428] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260808 21:01:34.383705 22897 heartbeater.cc:503] Master 127.14.146.254:36671 was elected leader, sending a full tablet report...
I20260808 21:01:34.384685 23118 raft_consensus.cc:348] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.384827 23118 raft_consensus.cc:374] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:34.384850 23118 raft_consensus.cc:729] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81569c8465fc448f9254cd440c605685, State: Initialized, Role: FOLLOWER
I20260808 21:01:34.384920 23118 consensus_queue.cc:260] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.385099 23118 ts_tablet_manager.cc:1428] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 21:01:34.385174 22699 heartbeater.cc:503] Master 127.14.146.254:36671 was elected leader, sending a full tablet report...
I20260808 21:01:34.386439 23125 raft_consensus.cc:482] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:34.386536 23125 raft_consensus.cc:504] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.386861 23125 leader_election.cc:288] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be451bcd20e34cd0a7e14ac5450c25dd (127.14.146.195:40153), 81569c8465fc448f9254cd440c605685 (127.14.146.193:44835)
I20260808 21:01:34.388098 22902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.386995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:40153 (local address 127.14.146.194:40923)
0808 21:01:34.387039 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.387053 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.387092 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.387270 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.387271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.387274 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:34.387742 (+ 468us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:01:34.387742 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:34.387750 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:01:34.387764 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:34.387938 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:34.387939 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:34.387939 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 21:01:34.387997 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 21:01:34.388011 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 21:01:34.388098 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.387109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:40923 (local address 127.14.146.195:40153)
0808 21:01:34.387148 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.387149 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.387156 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:01:34.387178 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.387179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.387183 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.387263 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.387853 (+ 590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.387855 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.387855 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.387860 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.387876 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.387881 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.387941 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.388000 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.388013 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:34.388264 23112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.387075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:59745 (local address 127.14.146.193:44835)
0808 21:01:34.387124 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.387126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.387306 (+ 180us) server_negotiation.cc:407] Connection header received
0808 21:01:34.387368 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.387369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.387373 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.387426 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.388024 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.388025 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.388025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.388030 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.388043 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.388048 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.388136 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.388187 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.388201 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:34.388288 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.387004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44835 (local address 127.14.146.194:59745)
0808 21:01:34.387239 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.387247 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.387310 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.387431 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.387432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.387434 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:34.387927 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:01:34.387927 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:34.387933 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:01:34.387944 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:34.388130 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:34.388130 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:34.388131 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 21:01:34.388187 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 21:01:34.388201 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":99,"thread_start_us":94,"threads_started":1}
I20260808 21:01:34.388478 23020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04198e91a8fa404b98cc55a06b09ea47" candidate_uuid: "3ccac0a50f924da688c790b7c3abbc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" is_pre_election: true
I20260808 21:01:34.388610 23020 raft_consensus.cc:2454] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ccac0a50f924da688c790b7c3abbc0a in term 0.
I20260808 21:01:34.388631 22633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04198e91a8fa404b98cc55a06b09ea47" candidate_uuid: "3ccac0a50f924da688c790b7c3abbc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81569c8465fc448f9254cd440c605685" is_pre_election: true
I20260808 21:01:34.388762 22633 raft_consensus.cc:2454] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ccac0a50f924da688c790b7c3abbc0a in term 0.
I20260808 21:01:34.388880 22729 leader_election.cc:302] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ccac0a50f924da688c790b7c3abbc0a, be451bcd20e34cd0a7e14ac5450c25dd; no voters:
I20260808 21:01:34.389022 23125 raft_consensus.cc:2781] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:34.389081 23125 raft_consensus.cc:482] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:34.389117 23125 raft_consensus.cc:3037] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:34.389773 23125 raft_consensus.cc:504] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.389918 23125 leader_election.cc:288] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [CANDIDATE]: Term 1 election: Requested vote from peers be451bcd20e34cd0a7e14ac5450c25dd (127.14.146.195:40153), 81569c8465fc448f9254cd440c605685 (127.14.146.193:44835)
I20260808 21:01:34.390039 23020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04198e91a8fa404b98cc55a06b09ea47" candidate_uuid: "3ccac0a50f924da688c790b7c3abbc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be451bcd20e34cd0a7e14ac5450c25dd"
I20260808 21:01:34.390064 22633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04198e91a8fa404b98cc55a06b09ea47" candidate_uuid: "3ccac0a50f924da688c790b7c3abbc0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81569c8465fc448f9254cd440c605685"
I20260808 21:01:34.390122 22633 raft_consensus.cc:3037] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:34.390129 23020 raft_consensus.cc:3037] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:34.391023 23020 raft_consensus.cc:2454] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ccac0a50f924da688c790b7c3abbc0a in term 1.
I20260808 21:01:34.391022 22633 raft_consensus.cc:2454] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ccac0a50f924da688c790b7c3abbc0a in term 1.
I20260808 21:01:34.391192 22729 leader_election.cc:302] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ccac0a50f924da688c790b7c3abbc0a, be451bcd20e34cd0a7e14ac5450c25dd; no voters:
I20260808 21:01:34.391324 23125 raft_consensus.cc:2781] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:34.391475 23125 raft_consensus.cc:686] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 1 LEADER]: Becoming Leader. State: Replica: 3ccac0a50f924da688c790b7c3abbc0a, State: Running, Role: LEADER
I20260808 21:01:34.391582 23125 consensus_queue.cc:237] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } }
I20260808 21:01:34.392304 22431 catalog_manager.cc:5495] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ccac0a50f924da688c790b7c3abbc0a (127.14.146.194). New cstate: current_term: 1 leader_uuid: "3ccac0a50f924da688c790b7c3abbc0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ccac0a50f924da688c790b7c3abbc0a" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:34.398456 23113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.397476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34832 (local address 127.14.146.194:36353)
0808 21:01:34.397530 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.397531 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.397539 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:34.397571 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.397572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.397581 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.397638 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.398233 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.398235 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.398235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.398239 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.398255 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.398259 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.398315 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.398371 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.398385 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 21:01:34.400172 23020 raft_consensus.cc:1261] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 1 FOLLOWER]: Refusing update from remote peer 3ccac0a50f924da688c790b7c3abbc0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:34.400194 22633 raft_consensus.cc:1261] T 04198e91a8fa404b98cc55a06b09ea47 P 81569c8465fc448f9254cd440c605685 [term 1 FOLLOWER]: Refusing update from remote peer 3ccac0a50f924da688c790b7c3abbc0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:34.400492 23129 consensus_queue.cc:1035] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be451bcd20e34cd0a7e14ac5450c25dd" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 40153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:34.400629 23125 consensus_queue.cc:1035] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "81569c8465fc448f9254cd440c605685" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:34.407104 22431 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:34.407217 22431 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:34.407940 22431 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 17e847257fbd492d92dc9454956e3e26: Sending DeleteTablet for 3 replicas of tablet 04198e91a8fa404b98cc55a06b09ea47
I20260808 21:01:34.408320 22992 tablet_service.cc:1514] Processing DeleteTablet for tablet 04198e91a8fa404b98cc55a06b09ea47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:34 UTC) from {username='slave'} at 127.0.0.1:35264
I20260808 21:01:34.408360 22603 tablet_service.cc:1514] Processing DeleteTablet for tablet 04198e91a8fa404b98cc55a06b09ea47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:34 UTC) from {username='slave'} at 127.0.0.1:52442
I20260808 21:01:34.408402 22801 tablet_service.cc:1514] Processing DeleteTablet for tablet 04198e91a8fa404b98cc55a06b09ea47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:34 UTC) from {username='slave'} at 127.0.0.1:34818
I20260808 21:01:34.408605 23146 tablet_replica.cc:330] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: stopping tablet replica
I20260808 21:01:34.408746 23146 raft_consensus.cc:2229] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:34.408859 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 22518
I20260808 21:01:34.417881 23146 raft_consensus.cc:2258] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:34.418514 23146 ts_tablet_manager.cc:1905] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:34.408799 23142 tablet_replica.cc:330] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: stopping tablet replica
I20260808 21:01:34.418792 23142 raft_consensus.cc:2229] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:34.418999 23142 raft_consensus.cc:2258] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:34.420414 23146 ts_tablet_manager.cc:1918] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:34.420540 23146 log.cc:1196] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/04198e91a8fa404b98cc55a06b09ea47
I20260808 21:01:34.420868 23146 ts_tablet_manager.cc:1939] T 04198e91a8fa404b98cc55a06b09ea47 P 3ccac0a50f924da688c790b7c3abbc0a: Deleting consensus metadata
I20260808 21:01:34.421360 22414 catalog_manager.cc:4841] TS 3ccac0a50f924da688c790b7c3abbc0a (127.14.146.194:36353): tablet 04198e91a8fa404b98cc55a06b09ea47 (table test-table [id=1a04061ddcb44f0bb3081903e0cbcc9b]) successfully deleted
W20260808 21:01:34.423982 22413 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:44835 (error 108)
I20260808 21:01:34.424630 23142 ts_tablet_manager.cc:1905] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:34.424799 23105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.424634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44835 (local address 127.0.0.1:52444)
0808 21:01:34.424711 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.424760 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:44835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 21:01:34.424945 22413 catalog_manager.cc:4584] TS 81569c8465fc448f9254cd440c605685 (127.14.146.193:44835): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 04198e91a8fa404b98cc55a06b09ea47: Network error: Client connection negotiation failed: client connection to 127.14.146.193:44835: connect: Connection refused (error 111)
I20260808 21:01:34.426378 23142 ts_tablet_manager.cc:1918] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:34.426478 23142 log.cc:1196] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/04198e91a8fa404b98cc55a06b09ea47
I20260808 21:01:34.426810 23142 ts_tablet_manager.cc:1939] T 04198e91a8fa404b98cc55a06b09ea47 P be451bcd20e34cd0a7e14ac5450c25dd: Deleting consensus metadata
I20260808 21:01:34.427403 22414 catalog_manager.cc:4841] TS be451bcd20e34cd0a7e14ac5450c25dd (127.14.146.195:40153): tablet 04198e91a8fa404b98cc55a06b09ea47 (table test-table [id=1a04061ddcb44f0bb3081903e0cbcc9b]) successfully deleted
I20260808 21:01:34.428210 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 22702
I20260808 21:01:34.440901 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 22903
I20260808 21:01:34.452382 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 22385
2026-08-08T21:01:34Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (637 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 21:01:34.477787 14923 mini_oidc.cc:152] Starting JWKS server
I20260808 21:01:34.479012 14923 webserver.cc:460] Webserver started at https://127.0.0.1:44635/ using document root <none> and password file <none>
I20260808 21:01:34.479143 14923 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 21:01:34.479324 14923 webserver.cc:460] Webserver started at http://127.0.0.1:46727/ using document root <none> and password file <none>
2026-08-08T21:01:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:34Z Disabled control of system clock
I20260808 21:01:34.488456 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45247
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:37261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45247
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44635/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/testchainca.cert with env {}
W20260808 21:01:34.572643 23159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:34.572842 23159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:34.572863 23159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:34.574033 23159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:34.574076 23159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:34.574088 23159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:34.574131 23159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:34.574157 23159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 21:01:34.574177 23159 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 21:01:34.574203 23159 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44635/jwks.json
I20260808 21:01:34.575755 23159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:37261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45247
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44635/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:34.575987 23159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:34.576225 23159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:34.581072 23168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:34.581084 23171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:34.581084 23169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:34.581350 23159 server_base.cc:1034] running on GCE node
I20260808 21:01:34.581658 23159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:34.581962 23159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:34.583125 23159 hybrid_clock.cc:648] HybridClock initialized: now 1786222894583106 us; error 44 us; skew 500 ppm
I20260808 21:01:34.584416 23159 webserver.cc:460] Webserver started at http://127.14.146.254:43923/ using document root <none> and password file <none>
I20260808 21:01:34.584678 23159 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:34.584749 23159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:34.584894 23159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:34.585955 23159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "60775878351f44e48e17f9b3843dfdbc"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "91f30a91c0bc2655cded99dcd20667c5"
server_key_iv: "3af39a626e69545d4a134c7f2ccf33eb"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.586325 23159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "60775878351f44e48e17f9b3843dfdbc"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "91f30a91c0bc2655cded99dcd20667c5"
server_key_iv: "3af39a626e69545d4a134c7f2ccf33eb"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.587641 23159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:01:34.588418 23179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.588595 23159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.588707 23159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "60775878351f44e48e17f9b3843dfdbc"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "91f30a91c0bc2655cded99dcd20667c5"
server_key_iv: "3af39a626e69545d4a134c7f2ccf33eb"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.588780 23159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:34.609912 23159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:34.610277 23159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:34.610435 23159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:34.614790 23159 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:45247
I20260808 21:01:34.614861 23246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:45247 every 8 connection(s)
I20260808 21:01:34.615221 23159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:34.616226 23249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:34.618530 23249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc: Bootstrap starting.
I20260808 21:01:34.619088 23249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:34.619335 23249 log.cc:824] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:34.619982 23249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc: No bootstrap required, opened a new log
I20260808 21:01:34.621611 23249 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60775878351f44e48e17f9b3843dfdbc" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45247 } }
I20260808 21:01:34.621754 23249 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:34.621778 23249 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60775878351f44e48e17f9b3843dfdbc, State: Initialized, Role: FOLLOWER
I20260808 21:01:34.621892 23249 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60775878351f44e48e17f9b3843dfdbc" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45247 } }
I20260808 21:01:34.621943 23249 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:34.621963 23249 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:34.621989 23249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:34.622473 23249 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60775878351f44e48e17f9b3843dfdbc" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45247 } }
I20260808 21:01:34.622573 23249 leader_election.cc:302] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60775878351f44e48e17f9b3843dfdbc; no voters:
I20260808 21:01:34.622707 23249 leader_election.cc:288] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:34.622777 23254 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:34.622968 23254 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [term 1 LEADER]: Becoming Leader. State: Replica: 60775878351f44e48e17f9b3843dfdbc, State: Running, Role: LEADER
I20260808 21:01:34.622983 23249 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:34.623091 23254 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60775878351f44e48e17f9b3843dfdbc" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45247 } }
I20260808 21:01:34.623131 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 23159
I20260808 21:01:34.623247 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:34.623456 14923 external_mini_cluster.cc:1428] Setting key bbd920bbea960c7fe7c7b3f6f82c4def
I20260808 21:01:34.624274 23258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60775878351f44e48e17f9b3843dfdbc. Latest consensus state: current_term: 1 leader_uuid: "60775878351f44e48e17f9b3843dfdbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60775878351f44e48e17f9b3843dfdbc" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45247 } } }
I20260808 21:01:34.624372 23258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:34.624588 23256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60775878351f44e48e17f9b3843dfdbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60775878351f44e48e17f9b3843dfdbc" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45247 } } }
I20260808 21:01:34.624835 23256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:34.624845 23282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:34.625392 23282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:34.626981 23282 catalog_manager.cc:1347] Generated new cluster ID: 7a312a360107459d8ba9d368a9067a42
I20260808 21:01:34.627039 23282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:34.629259 23269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.623898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58852 (local address 127.14.146.254:45247)
0808 21:01:34.624350 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.624360 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.624397 (+ 37us) server_negotiation.cc:407] Connection header received
0808 21:01:34.624729 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.624736 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.624817 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.624968 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.625256 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.626350 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.627358 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.627782 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.627911 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:34.628647 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.628655 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.628655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.628815 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.628846 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.628856 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.628924 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.629006 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.629086 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":89,"threads_started":1}
I20260808 21:01:34.630167 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:01:34.693589 23282 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:34.694208 23282 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:34.699975 23282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60775878351f44e48e17f9b3843dfdbc: Generated new TSK 0
I20260808 21:01:34.700199 23282 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 21:01:34.737561 23294 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:34.714287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45247 (local address 127.0.0.1:58864)
0808 21:01:34.714515 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.714528 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.714619 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.714811 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.714812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.714814 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 21:01:34.714884 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:34.714887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.715530 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.715532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:34.716504 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:34.716509 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.716888 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.716889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:34.716957 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:34.716981 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 21:01:34.736950 (+ 19969us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44635/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 21:01:34.737081 (+ 131us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.146.254:45247: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44635/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":185,"threads_started":1}
I20260808 21:01:34.737943 23269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.714401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58864 (local address 127.14.146.254:45247)
0808 21:01:34.714455 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.714457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.714611 (+ 154us) server_negotiation.cc:407] Connection header received
0808 21:01:34.714719 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.714720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.714732 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.714790 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0808 21:01:34.714947 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.715422 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.716601 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.716787 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.716837 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:34.717090 (+ 253us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 21:01:34.736747 (+ 19657us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44635/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 21:01:34.737862 (+ 1115us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58864: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44635/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":27}
W20260808 21:01:34.737998 23269 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58864: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44635/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
E20260808 21:01:34.738348 23295 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 21:01:34.738451 23295 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.14.146.254:45247: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44635/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 21:01:34.740499 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 23159
2026-08-08T21:01:34Z chronyd exiting
I20260808 21:01:34.787179 14923 test_util.cc:175] -----------------------------------------------
I20260808 21:01:34.787266 14923 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786222870463854-14923-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (310 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 21:01:34.788159 14923 mini_oidc.cc:152] Starting JWKS server
I20260808 21:01:34.788872 14923 webserver.cc:460] Webserver started at https://127.0.0.1:36251/ using document root <none> and password file <none>
I20260808 21:01:34.788939 14923 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 21:01:34.789085 14923 webserver.cc:460] Webserver started at http://127.0.0.1:42395/ using document root <none> and password file <none>
2026-08-08T21:01:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:34Z Disabled control of system clock
I20260808 21:01:34.798243 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:40777
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:45229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:40777
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36251/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/testchainca.cert with env {}
W20260808 21:01:34.881577 23305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:34.881774 23305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:34.881798 23305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:34.882959 23305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:34.883002 23305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:34.883015 23305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:34.883028 23305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:34.883082 23305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 21:01:34.883100 23305 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 21:01:34.883131 23305 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36251/jwks.json
I20260808 21:01:34.884683 23305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:45229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:40777
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:40777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36251/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:34.884927 23305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:34.885150 23305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:34.890082 23316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:34.890329 23305 server_base.cc:1034] running on GCE node
W20260808 21:01:34.890115 23314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:34.890079 23313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:34.890704 23305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:34.891013 23305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:34.892119 23305 hybrid_clock.cc:648] HybridClock initialized: now 1786222894892103 us; error 29 us; skew 500 ppm
I20260808 21:01:34.893548 23305 webserver.cc:460] Webserver started at http://127.14.146.254:42585/ using document root <none> and password file <none>
I20260808 21:01:34.893823 23305 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:34.893872 23305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:34.894042 23305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:34.895123 23305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "954dd4318742438a93f69b4439242d61"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "356ee494b47bdca0790dd46edb3d1fef"
server_key_iv: "92b3ce9de659cc95e3822dab50dc2a4c"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.895493 23305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "954dd4318742438a93f69b4439242d61"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "356ee494b47bdca0790dd46edb3d1fef"
server_key_iv: "92b3ce9de659cc95e3822dab50dc2a4c"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.896938 23305 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:34.897680 23324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:34.897861 23305 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:34.897950 23305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "954dd4318742438a93f69b4439242d61"
format_stamp: "Formatted at 2026-08-08 21:01:34 on dist-test-slave-t3q3"
server_key: "356ee494b47bdca0790dd46edb3d1fef"
server_key_iv: "92b3ce9de659cc95e3822dab50dc2a4c"
server_key_version: "encryptionkey@0"
I20260808 21:01:34.898008 23305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:34.912493 23305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:34.912792 23305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:34.912902 23305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:34.916900 23305 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:40777
I20260808 21:01:34.916965 23401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:40777 every 8 connection(s)
I20260808 21:01:34.917322 23305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:34.918052 23402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:34.921036 23402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61: Bootstrap starting.
I20260808 21:01:34.921592 23402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:34.921850 23402 log.cc:824] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:34.922546 23402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61: No bootstrap required, opened a new log
I20260808 21:01:34.922701 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 23305
I20260808 21:01:34.922801 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:34.922988 14923 external_mini_cluster.cc:1428] Setting key 1f44cebe9e51f68a5327fe44f11735c5
I20260808 21:01:34.924947 23402 raft_consensus.cc:348] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "954dd4318742438a93f69b4439242d61" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40777 } }
I20260808 21:01:34.925194 23402 raft_consensus.cc:374] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:34.925297 23402 raft_consensus.cc:729] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 954dd4318742438a93f69b4439242d61, State: Initialized, Role: FOLLOWER
I20260808 21:01:34.925455 23402 consensus_queue.cc:260] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "954dd4318742438a93f69b4439242d61" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40777 } }
I20260808 21:01:34.925551 23402 raft_consensus.cc:388] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:34.925585 23402 raft_consensus.cc:482] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:34.925638 23402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:34.926440 23402 raft_consensus.cc:504] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "954dd4318742438a93f69b4439242d61" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40777 } }
I20260808 21:01:34.926560 23402 leader_election.cc:302] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 954dd4318742438a93f69b4439242d61; no voters:
I20260808 21:01:34.926719 23402 leader_election.cc:288] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:34.926771 23407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:34.926930 23407 raft_consensus.cc:686] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [term 1 LEADER]: Becoming Leader. State: Replica: 954dd4318742438a93f69b4439242d61, State: Running, Role: LEADER
I20260808 21:01:34.926991 23402 sys_catalog.cc:564] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:34.927093 23407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "954dd4318742438a93f69b4439242d61" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40777 } }
I20260808 21:01:34.927450 23407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 954dd4318742438a93f69b4439242d61. Latest consensus state: current_term: 1 leader_uuid: "954dd4318742438a93f69b4439242d61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "954dd4318742438a93f69b4439242d61" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40777 } } }
I20260808 21:01:34.927646 23407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:34.927578 23408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "954dd4318742438a93f69b4439242d61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "954dd4318742438a93f69b4439242d61" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40777 } } }
I20260808 21:01:34.928170 23408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61 [sys.catalog]: This master's current role is: LEADER
W20260808 21:01:34.929066 23430 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:01:34.929143 23430 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:01:34.929204 23418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:34.929364 23418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:34.931049 23406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.923527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47656 (local address 127.14.146.254:40777)
0808 21:01:34.923744 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.923752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.923788 (+ 36us) server_negotiation.cc:407] Connection header received
0808 21:01:34.924899 (+ 1111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.924910 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.925006 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.925163 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:34.925513 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.927378 (+ 1865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.928689 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.929362 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.929504 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:34.930278 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:34.930282 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:34.930282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:34.930488 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:34.930550 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:34.930567 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:34.930646 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:34.930746 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 21:01:34.930829 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
I20260808 21:01:34.931058 23418 catalog_manager.cc:1347] Generated new cluster ID: fbbb0ba4959840e69481243913262ae7
I20260808 21:01:34.931124 23418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:34.932101 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:01:34.943542 23418 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:34.944170 23418 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:34.946803 23418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 954dd4318742438a93f69b4439242d61: Generated new TSK 0
I20260808 21:01:34.947007 23418 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 21:01:34.969956 23444 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 21:01:34.970055 23444 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 21:01:34.970418 23406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:34.955903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47662 (local address 127.14.146.254:40777)
0808 21:01:34.955975 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:34.955977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:34.956143 (+ 166us) server_negotiation.cc:407] Connection header received
0808 21:01:34.956194 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:34.956195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:34.956208 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:34.956300 (+ 92us) server_negotiation.cc:226] Negotiated authn=JWT
0808 21:01:34.956418 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.957230 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.958006 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.958320 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.958386 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:34.958554 (+ 168us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 21:01:34.970168 (+ 11614us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 21:01:34.970329 (+ 161us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47662: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 21:01:34.970484 23406 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47662: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 21:01:34.970463 23442 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:34.955841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40777 (local address 127.0.0.1:47662)
0808 21:01:34.956022 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:34.956032 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:34.956132 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:34.956297 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:34.956297 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:34.956299 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 21:01:34.956352 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:34.956354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.957320 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.957322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:34.957921 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:34.957923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:34.958406 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:34.958407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:34.958450 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:34.958454 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 21:01:34.970287 (+ 11833us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 21:01:34.970392 (+ 105us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.146.254:40777: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36251/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":98,"threads_started":1}
I20260808 21:01:34.971050 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 23305
2026-08-08T21:01:35Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (230 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 21:01:35.018548 14923 mini_oidc.cc:152] Starting JWKS server
I20260808 21:01:35.019277 14923 webserver.cc:460] Webserver started at https://127.0.0.1:39487/ using document root <none> and password file <none>
I20260808 21:01:35.019344 14923 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 21:01:35.019500 14923 webserver.cc:460] Webserver started at http://127.0.0.1:42897/ using document root <none> and password file <none>
2026-08-08T21:01:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:35Z Disabled control of system clock
I20260808 21:01:35.028642 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:35101
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:43121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:35101
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39487/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 21:01:35.109951 23456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:35.110208 23456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:35.110260 23456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:35.111433 23456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:35.111500 23456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:35.111522 23456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:35.111543 23456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:35.111572 23456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 21:01:35.111595 23456 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 21:01:35.111625 23456 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39487/jwks.json
I20260808 21:01:35.113058 23456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:35101
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:35101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39487/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:35.113346 23456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:35.113649 23456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:35.118844 23466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:35.118851 23465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:35.119053 23456 server_base.cc:1034] running on GCE node
W20260808 21:01:35.118861 23470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:35.119331 23456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:35.119645 23456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:35.120791 23456 hybrid_clock.cc:648] HybridClock initialized: now 1786222895120777 us; error 33 us; skew 500 ppm
I20260808 21:01:35.122131 23456 webserver.cc:460] Webserver started at http://127.14.146.254:45269/ using document root <none> and password file <none>
I20260808 21:01:35.122401 23456 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:35.122452 23456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:35.122639 23456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:35.123771 23456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "6d86c457a1fc448c8e164d488cee497b"
format_stamp: "Formatted at 2026-08-08 21:01:35 on dist-test-slave-t3q3"
server_key: "f4ac6885d39199ee211e453f78763294"
server_key_iv: "31885ffd4304b14081aefcb92ac07f45"
server_key_version: "encryptionkey@0"
I20260808 21:01:35.124197 23456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "6d86c457a1fc448c8e164d488cee497b"
format_stamp: "Formatted at 2026-08-08 21:01:35 on dist-test-slave-t3q3"
server_key: "f4ac6885d39199ee211e453f78763294"
server_key_iv: "31885ffd4304b14081aefcb92ac07f45"
server_key_version: "encryptionkey@0"
I20260808 21:01:35.125635 23456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:35.126376 23480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:35.126555 23456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:35.126662 23456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "6d86c457a1fc448c8e164d488cee497b"
format_stamp: "Formatted at 2026-08-08 21:01:35 on dist-test-slave-t3q3"
server_key: "f4ac6885d39199ee211e453f78763294"
server_key_iv: "31885ffd4304b14081aefcb92ac07f45"
server_key_version: "encryptionkey@0"
I20260808 21:01:35.126746 23456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:35.145958 23456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:35.146340 23456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:35.146510 23456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:35.150823 23456 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:35101
I20260808 21:01:35.150866 23551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:35101 every 8 connection(s)
I20260808 21:01:35.151276 23456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:35.152010 23552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:35.152930 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 23456
I20260808 21:01:35.153026 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:35.153259 14923 external_mini_cluster.cc:1428] Setting key de8642aff9bbb3c40b346f15525c18be
I20260808 21:01:35.155947 23552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b: Bootstrap starting.
I20260808 21:01:35.156718 23552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:35.157145 23552 log.cc:824] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:35.157923 23552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b: No bootstrap required, opened a new log
I20260808 21:01:35.159526 23556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:35.153839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.14.146.254:35101)
0808 21:01:35.154077 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:35.154088 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:35.154128 (+ 40us) server_negotiation.cc:407] Connection header received
0808 21:01:35.154699 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:35.154708 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:35.154805 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:35.154966 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:35.155184 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.156585 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.157450 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.157983 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.158128 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:35.158877 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:35.158881 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:35.158881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:35.159051 (+ 170us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:35.159084 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:35.159095 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:35.159169 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:35.159279 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 21:01:35.159362 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":90,"threads_started":1}
I20260808 21:01:35.160039 23552 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d86c457a1fc448c8e164d488cee497b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35101 } }
I20260808 21:01:35.160290 23552 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:35.160342 23552 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d86c457a1fc448c8e164d488cee497b, State: Initialized, Role: FOLLOWER
I20260808 21:01:35.160472 23552 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d86c457a1fc448c8e164d488cee497b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35101 } }
I20260808 21:01:35.160507 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:01:35.160558 23552 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:35.160611 23552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:35.160660 23552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:35.161231 23552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d86c457a1fc448c8e164d488cee497b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35101 } }
I20260808 21:01:35.161355 23552 leader_election.cc:302] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d86c457a1fc448c8e164d488cee497b; no voters:
I20260808 21:01:35.161540 23552 leader_election.cc:288] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:35.161569 23559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:35.161727 23559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [term 1 LEADER]: Becoming Leader. State: Replica: 6d86c457a1fc448c8e164d488cee497b, State: Running, Role: LEADER
I20260808 21:01:35.161813 23552 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:35.161868 23559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d86c457a1fc448c8e164d488cee497b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35101 } }
I20260808 21:01:35.162292 23560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d86c457a1fc448c8e164d488cee497b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d86c457a1fc448c8e164d488cee497b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35101 } } }
I20260808 21:01:35.162313 23561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d86c457a1fc448c8e164d488cee497b. Latest consensus state: current_term: 1 leader_uuid: "6d86c457a1fc448c8e164d488cee497b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d86c457a1fc448c8e164d488cee497b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35101 } } }
I20260808 21:01:35.162436 23560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:35.162443 23561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:35.163067 23571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:35.163558 23571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:35.165163 23571 catalog_manager.cc:1347] Generated new cluster ID: 8cd1d4fe81744438bcd0b5ea1b40fafd
I20260808 21:01:35.165218 23571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:35.174713 23571 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:35.175299 23571 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:35.181669 23571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d86c457a1fc448c8e164d488cee497b: Generated new TSK 0
I20260808 21:01:35.181872 23571 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:01:35.196125 23556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:35.191969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52962 (local address 127.14.146.254:35101)
0808 21:01:35.192093 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:35.192096 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:35.192170 (+ 74us) server_negotiation.cc:407] Connection header received
0808 21:01:35.192256 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:35.192257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:35.192268 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:35.192326 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0808 21:01:35.192630 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.193213 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.194382 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.194584 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.194643 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:35.194882 (+ 239us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 21:01:35.195862 (+ 980us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 21:01:35.196002 (+ 140us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52962: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 21:01:35.196198 23556 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52962: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 21:01:35.196204 23594 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:35.191846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:35101 (local address 127.0.0.1:52962)
0808 21:01:35.192056 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:35.192090 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:35.192169 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:35.192409 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:35.192410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:35.192420 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0808 21:01:35.192503 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:35.192507 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.193301 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.193302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:35.194289 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:35.194292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.194667 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.194668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:35.194726 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:35.194732 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 21:01:35.195966 (+ 1234us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 21:01:35.196101 (+ 135us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.146.254:35101: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":123,"threads_started":1}
I20260808 21:01:35.196851 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 23456
E20260808 21:01:35.214819 23595 webserver.cc:533] Webserver: sslize failed:
E20260808 21:01:35.214928 23595 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T21:01:35Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T21:01:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:35Z Disabled control of system clock
I20260808 21:01:35.260751 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:44985
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:34813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:44985
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/testchainca.cert with env {}
W20260808 21:01:35.344583 23606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:35.344828 23606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:35.344868 23606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:35.346050 23606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:35.346113 23606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:35.346134 23606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:35.346169 23606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:35.346199 23606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 21:01:35.346222 23606 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 21:01:35.346246 23606 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 21:01:35.347736 23606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:44985
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:44985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:35.348018 23606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:35.348254 23606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:35.353205 23611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:35.353256 23612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:35.353287 23614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:35.353552 23606 server_base.cc:1034] running on GCE node
I20260808 21:01:35.353838 23606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:35.354156 23606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:35.355324 23606 hybrid_clock.cc:648] HybridClock initialized: now 1786222895355314 us; error 31 us; skew 500 ppm
I20260808 21:01:35.356779 23606 webserver.cc:460] Webserver started at http://127.14.146.254:37847/ using document root <none> and password file <none>
I20260808 21:01:35.357019 23606 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:35.357089 23606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:35.357254 23606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:35.358319 23606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "c2655599a15448a790c4e8a12a27e9c0"
format_stamp: "Formatted at 2026-08-08 21:01:35 on dist-test-slave-t3q3"
server_key: "fdb978df67a0fad080e5c233c82616b8"
server_key_iv: "8511d2aec441faa5f1eee188571a85d9"
server_key_version: "encryptionkey@0"
I20260808 21:01:35.358695 23606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "c2655599a15448a790c4e8a12a27e9c0"
format_stamp: "Formatted at 2026-08-08 21:01:35 on dist-test-slave-t3q3"
server_key: "fdb978df67a0fad080e5c233c82616b8"
server_key_iv: "8511d2aec441faa5f1eee188571a85d9"
server_key_version: "encryptionkey@0"
I20260808 21:01:35.360037 23606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 21:01:35.360817 23624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:35.360993 23606 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:35.361097 23606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "c2655599a15448a790c4e8a12a27e9c0"
format_stamp: "Formatted at 2026-08-08 21:01:35 on dist-test-slave-t3q3"
server_key: "fdb978df67a0fad080e5c233c82616b8"
server_key_iv: "8511d2aec441faa5f1eee188571a85d9"
server_key_version: "encryptionkey@0"
I20260808 21:01:35.361177 23606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:35.376614 23606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:35.376924 23606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:35.377072 23606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:35.381248 23606 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:44985
I20260808 21:01:35.381287 23696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:44985 every 8 connection(s)
I20260808 21:01:35.381649 23606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:35.382642 23697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:35.384994 23697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0: Bootstrap starting.
I20260808 21:01:35.385401 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 23606
I20260808 21:01:35.385509 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:35.385721 14923 external_mini_cluster.cc:1428] Setting key d79352f54d8ad0faaacfe819e20c3c92
I20260808 21:01:35.385777 23697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:35.386107 23697 log.cc:824] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:35.386945 23697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0: No bootstrap required, opened a new log
I20260808 21:01:35.389477 23697 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2655599a15448a790c4e8a12a27e9c0" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44985 } }
I20260808 21:01:35.389614 23697 raft_consensus.cc:374] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:35.389644 23697 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2655599a15448a790c4e8a12a27e9c0, State: Initialized, Role: FOLLOWER
I20260808 21:01:35.389788 23697 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2655599a15448a790c4e8a12a27e9c0" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44985 } }
I20260808 21:01:35.389868 23697 raft_consensus.cc:388] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:35.389909 23697 raft_consensus.cc:482] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:35.389957 23697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:35.390669 23697 raft_consensus.cc:504] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2655599a15448a790c4e8a12a27e9c0" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44985 } }
I20260808 21:01:35.390776 23697 leader_election.cc:302] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c2655599a15448a790c4e8a12a27e9c0; no voters:
I20260808 21:01:35.390942 23697 leader_election.cc:288] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:35.391117 23706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:35.391212 23697 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:35.391285 23706 raft_consensus.cc:686] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [term 1 LEADER]: Becoming Leader. State: Replica: c2655599a15448a790c4e8a12a27e9c0, State: Running, Role: LEADER
I20260808 21:01:35.391398 23706 consensus_queue.cc:237] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2655599a15448a790c4e8a12a27e9c0" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44985 } }
I20260808 21:01:35.391760 23706 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c2655599a15448a790c4e8a12a27e9c0. Latest consensus state: current_term: 1 leader_uuid: "c2655599a15448a790c4e8a12a27e9c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2655599a15448a790c4e8a12a27e9c0" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44985 } } }
I20260808 21:01:35.391849 23706 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:35.392045 23717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:35.392568 23717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:35.391772 23707 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c2655599a15448a790c4e8a12a27e9c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c2655599a15448a790c4e8a12a27e9c0" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44985 } } }
I20260808 21:01:35.392624 23707 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:35.393090 23704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:35.386306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40772 (local address 127.14.146.254:44985)
0808 21:01:35.386547 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:35.386554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:35.386606 (+ 52us) server_negotiation.cc:407] Connection header received
0808 21:01:35.387236 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:35.387245 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:35.387338 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:35.387501 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:35.387726 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.389240 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.390229 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.390876 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.391001 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:35.391820 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:35.391824 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:35.391824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:01:35.392054 (+ 230us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:35.392118 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:01:35.392142 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:35.392206 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:35.392765 (+ 559us) server_negotiation.cc:299] Negotiation successful
0808 21:01:35.392856 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":101,"threads_started":1}
I20260808 21:01:35.394083 23717 catalog_manager.cc:1347] Generated new cluster ID: 6c6bac1dcb3f4b37b29263cb7d786f44
I20260808 21:01:35.394101 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:01:35.394136 23717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:35.401173 23717 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:35.401664 23717 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:35.406092 23717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c2655599a15448a790c4e8a12a27e9c0: Generated new TSK 0
I20260808 21:01:35.406284 23717 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:01:35.884636 23704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:35.418696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40776 (local address 127.14.146.254:44985)
0808 21:01:35.418739 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:35.418741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:35.418813 (+ 72us) server_negotiation.cc:407] Connection header received
0808 21:01:35.418867 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:35.418868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:35.418880 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:35.418958 (+ 78us) server_negotiation.cc:226] Negotiated authn=JWT
0808 21:01:35.419071 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.419874 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.420671 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.420980 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.421047 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:35.421203 (+ 156us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 21:01:35.884401 (+463198us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 21:01:35.884572 (+ 171us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40776: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 21:01:35.884714 23704 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40776: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 21:01:35.884917 23741 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:35.418596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:44985 (local address 127.0.0.1:40776)
0808 21:01:35.418741 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:35.418752 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:35.418813 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:35.418957 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:35.418958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:35.418959 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 21:01:35.419010 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:35.419012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.419947 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.419947 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:35.420592 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:35.420595 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:35.421067 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:35.421068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:35.421112 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:35.421117 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 21:01:35.884582 (+463465us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 21:01:35.884769 (+ 187us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.146.254:44985: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":97,"threads_started":1}
I20260808 21:01:35.885332 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 23606
2026-08-08T21:01:35Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (658 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (92 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:36 dist-test-slave-t3q3 krb5kdc[23759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:36 dist-test-slave-t3q3 krb5kdc[23759](info): set up 2 sockets
Aug 08 21:01:36 dist-test-slave-t3q3 krb5kdc[23759](info): commencing operation
krb5kdc: starting...
W20260808 21:01:37.315949 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:37 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:37.449278 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:41727
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:33341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:41727
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:37.534581 23776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:37.534823 23776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:37.534864 23776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:37.536036 23776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:37.536140 23776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:37.536170 23776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:37.536197 23776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:37.536230 23776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:37.537735 23776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:33341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:41727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:41727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:37.538019 23776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:37.538244 23776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:37.543254 23784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:37.543251 23781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:37.543313 23782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:37.543515 23776 server_base.cc:1034] running on GCE node
I20260808 21:01:37.543834 23776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:37.544260 23776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:37.545446 23776 hybrid_clock.cc:648] HybridClock initialized: now 1786222897545426 us; error 29 us; skew 500 ppm
Aug 08 21:01:37 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:37.548177 23776 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:37.548720 23776 webserver.cc:460] Webserver started at http://127.14.146.254:43413/ using document root <none> and password file <none>
I20260808 21:01:37.549010 23776 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:37.549083 23776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:37.549249 23776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:37.550411 23776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "c18df4c966414d64be2a9292ae0d4c3f"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "382562ded2daf3851fcdaa8338a78572"
server_key_iv: "bde2cc868dbb76064e2cd3c016c79fe6"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.550832 23776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "c18df4c966414d64be2a9292ae0d4c3f"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "382562ded2daf3851fcdaa8338a78572"
server_key_iv: "bde2cc868dbb76064e2cd3c016c79fe6"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.552353 23776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:37.553112 23793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:37.553296 23776 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:37.553411 23776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "c18df4c966414d64be2a9292ae0d4c3f"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "382562ded2daf3851fcdaa8338a78572"
server_key_iv: "bde2cc868dbb76064e2cd3c016c79fe6"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.553503 23776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:37.567049 23776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:37.569001 23776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:37.569180 23776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:37.573455 23776 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:41727
I20260808 21:01:37.573504 23866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:41727 every 8 connection(s)
I20260808 21:01:37.573870 23776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:37.574780 23867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:37.575171 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 23776
I20260808 21:01:37.575276 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:37.575470 14923 external_mini_cluster.cc:1428] Setting key 120f48f4f8f0d9af35e780a9128daf58
I20260808 21:01:37.577910 23867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f: Bootstrap starting.
I20260808 21:01:37.578508 23867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:37.578796 23867 log.cc:824] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:37.579476 23867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f: No bootstrap required, opened a new log
I20260808 21:01:37.581357 23867 raft_consensus.cc:348] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18df4c966414d64be2a9292ae0d4c3f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41727 } }
I20260808 21:01:37.581565 23867 raft_consensus.cc:374] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:37.581604 23867 raft_consensus.cc:729] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c18df4c966414d64be2a9292ae0d4c3f, State: Initialized, Role: FOLLOWER
I20260808 21:01:37.581732 23867 consensus_queue.cc:260] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18df4c966414d64be2a9292ae0d4c3f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41727 } }
I20260808 21:01:37.581840 23867 raft_consensus.cc:388] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:37.581879 23867 raft_consensus.cc:482] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:37.581923 23867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 0 FOLLOWER]: Advancing to term 1
Aug 08 21:01:37 dist-test-slave-t3q3 krb5kdc[23759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:37.582688 23867 raft_consensus.cc:504] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18df4c966414d64be2a9292ae0d4c3f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41727 } }
I20260808 21:01:37.582818 23867 leader_election.cc:302] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c18df4c966414d64be2a9292ae0d4c3f; no voters:
I20260808 21:01:37.583010 23867 leader_election.cc:288] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:37.583041 23876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:37.583163 23876 raft_consensus.cc:686] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [term 1 LEADER]: Becoming Leader. State: Replica: c18df4c966414d64be2a9292ae0d4c3f, State: Running, Role: LEADER
I20260808 21:01:37.583305 23867 sys_catalog.cc:564] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:37.583280 23876 consensus_queue.cc:237] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18df4c966414d64be2a9292ae0d4c3f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41727 } }
I20260808 21:01:37.583736 23878 sys_catalog.cc:455] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c18df4c966414d64be2a9292ae0d4c3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18df4c966414d64be2a9292ae0d4c3f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41727 } } }
I20260808 21:01:37.583782 23879 sys_catalog.cc:455] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c18df4c966414d64be2a9292ae0d4c3f. Latest consensus state: current_term: 1 leader_uuid: "c18df4c966414d64be2a9292ae0d4c3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c18df4c966414d64be2a9292ae0d4c3f" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41727 } } }
I20260808 21:01:37.583890 23879 sys_catalog.cc:458] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:37.583841 23878 sys_catalog.cc:458] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f [sys.catalog]: This master's current role is: LEADER
W20260808 21:01:37.585584 23900 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:01:37.585656 23900 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:01:37.585706 23882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:37.585880 23882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:37.586555 23872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:37.575985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33224 (local address 127.14.146.254:41727)
0808 21:01:37.576208 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:37.576224 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:37.576248 (+ 24us) server_negotiation.cc:407] Connection header received
0808 21:01:37.576657 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:37.576664 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:37.576708 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:37.576821 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:37.577608 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.578526 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.579348 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.579832 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.579965 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:37.582653 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:37.582657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:37.582657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:37.582668 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:37.584827 (+ 2159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:37.585192 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:37.585195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:37.585196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:37.585393 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:37.585594 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:37.585595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:37.585596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:37.585934 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:37.586092 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:37.586207 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 21:01:37.586346 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":116,"threads_started":1}
I20260808 21:01:37.587327 23882 catalog_manager.cc:1347] Generated new cluster ID: eee5893c40a543c78040bd49b852034d
I20260808 21:01:37.587381 23882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:37.609762 23882 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:37.610353 23882 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:37.614943 23882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c18df4c966414d64be2a9292ae0d4c3f: Generated new TSK 0
I20260808 21:01:37.615187 23882 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:37.646589 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41727
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:33341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:37.753624 23907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:37.753849 23907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:37.753875 23907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:37.755067 23907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:37.755110 23907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:37.755137 23907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:37.756716 23907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:33341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:37.756965 23907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:37.757210 23907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:37.762320 23916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:37.762326 23913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:37.762557 23907 server_base.cc:1034] running on GCE node
W20260808 21:01:37.762315 23914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:37.762933 23907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:37.763201 23907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:37.764379 23907 hybrid_clock.cc:648] HybridClock initialized: now 1786222897764353 us; error 39 us; skew 500 ppm
Aug 08 21:01:37 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:37.766901 23907 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:37.767306 23907 webserver.cc:460] Webserver started at http://127.14.146.193:42011/ using document root <none> and password file <none>
I20260808 21:01:37.767493 23907 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:37.767534 23907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:37.767627 23907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:37.768723 23907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "d1f77c8dbefa4320ace624e0993a92c9"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "8bf8031fe39144719c17710bff7df669"
server_key_iv: "3f741aa0c0afde66edaa894492a590fa"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.769042 23907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "d1f77c8dbefa4320ace624e0993a92c9"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "8bf8031fe39144719c17710bff7df669"
server_key_iv: "3f741aa0c0afde66edaa894492a590fa"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.770360 23907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:01:37.771077 23930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:37.771286 23907 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:37.771373 23907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "d1f77c8dbefa4320ace624e0993a92c9"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "8bf8031fe39144719c17710bff7df669"
server_key_iv: "3f741aa0c0afde66edaa894492a590fa"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.771427 23907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:37.780646 23907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:37.783043 23907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:37.783166 23907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:37.783383 23907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:37.783671 23907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:37.783705 23907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:37.783834 23907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:37.783872 23907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:37.789783 23907 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:45415
I20260808 21:01:37.789861 24122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:45415 every 8 connection(s)
I20260808 21:01:37.790218 23907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:37.793042 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 23907
I20260808 21:01:37.793164 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:37.793383 14923 external_mini_cluster.cc:1428] Setting key a1d22935c9bb6e5bb63d5b21d557dc43
Aug 08 21:01:37 dist-test-slave-t3q3 krb5kdc[23759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:37.801132 23872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:37.791019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:32777 (local address 127.14.146.254:41727)
0808 21:01:37.791077 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:37.791079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:37.791261 (+ 182us) server_negotiation.cc:407] Connection header received
0808 21:01:37.792300 (+ 1039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:37.792302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:37.792313 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:37.792365 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:37.793127 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.793787 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.794929 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.795258 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.795326 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:37.797882 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:37.797883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:37.797884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:37.797892 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:37.799617 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:37.800018 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:37.800019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:37.800020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:37.800123 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:37.800379 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:37.800381 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:37.800381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:37.800549 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:37.800632 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:37.800894 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 21:01:37.800996 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 21:01:37.801143 24125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:37.790993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:41727 (local address 127.14.146.193:32777)
0808 21:01:37.791152 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:37.791188 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:37.792198 (+ 1010us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:37.792430 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:37.792433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:37.792704 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:37.793008 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:37.793016 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.793880 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.793881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:37.794832 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:37.794835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.795353 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.795354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:37.795496 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:37.796129 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:37.796140 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:37.797786 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:37.799703 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:37.799710 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:37.799711 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:37.799941 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:37.800201 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:37.800202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:37.800202 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:37.800309 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:37.800619 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:37.800623 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:37.800755 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 21:01:37.800840 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:01:37.800969 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260808 21:01:37.801704 24123 heartbeater.cc:347] Connected to a master server at 127.14.146.254:41727
I20260808 21:01:37.801821 24123 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:37.802042 24123 heartbeater.cc:511] Master 127.14.146.254:41727 requested a full tablet report, sending...
I20260808 21:01:37.802610 23813 ts_manager.cc:194] Registered new tserver with Master: d1f77c8dbefa4320ace624e0993a92c9 (127.14.146.193:45415)
I20260808 21:01:37.803257 23813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:32777
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:37.823511 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41727
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:33341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:37.907580 24129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:37.907794 24129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:37.907819 24129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:37.909006 24129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:37.909070 24129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:37.909097 24129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:37.910676 24129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:33341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:37.910950 24129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:37.911197 24129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:37.916517 24135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:37.916538 24136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:37.916644 24129 server_base.cc:1034] running on GCE node
W20260808 21:01:37.916527 24138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:37.916983 24129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:37.917240 24129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:37.918378 24129 hybrid_clock.cc:648] HybridClock initialized: now 1786222897918367 us; error 28 us; skew 500 ppm
Aug 08 21:01:37 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:37.920912 24129 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:37.921383 24129 webserver.cc:460] Webserver started at http://127.14.146.194:33585/ using document root <none> and password file <none>
I20260808 21:01:37.921626 24129 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:37.921690 24129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:37.921847 24129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:37.922881 24129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "4726efce93d24ae4aad6c967537b49f4"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "f32fc532a834f157a5ad580db9c5dcce"
server_key_iv: "0921c459e9780c1883f5aee528b81004"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.923240 24129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "4726efce93d24ae4aad6c967537b49f4"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "f32fc532a834f157a5ad580db9c5dcce"
server_key_iv: "0921c459e9780c1883f5aee528b81004"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.924659 24129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 21:01:37.925498 24149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:37.925693 24129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:37.925808 24129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "4726efce93d24ae4aad6c967537b49f4"
format_stamp: "Formatted at 2026-08-08 21:01:37 on dist-test-slave-t3q3"
server_key: "f32fc532a834f157a5ad580db9c5dcce"
server_key_iv: "0921c459e9780c1883f5aee528b81004"
server_key_version: "encryptionkey@0"
I20260808 21:01:37.925880 24129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:37.938603 24129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:37.940696 24129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:37.940869 24129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:37.941097 24129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:37.941406 24129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:37.941457 24129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:37.941490 24129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:37.941517 24129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:37.947492 24129 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:44107
I20260808 21:01:37.947530 24317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:44107 every 8 connection(s)
I20260808 21:01:37.947880 24129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:37.949373 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 24129
I20260808 21:01:37.949492 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:37.949729 14923 external_mini_cluster.cc:1428] Setting key d905ef18821edb7d8f87722793eff6e4
Aug 08 21:01:37 dist-test-slave-t3q3 krb5kdc[23759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222897, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:37.958488 23872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:37.948702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:36925 (local address 127.14.146.254:41727)
0808 21:01:37.948774 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:37.948776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:37.948947 (+ 171us) server_negotiation.cc:407] Connection header received
0808 21:01:37.950279 (+ 1332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:37.950280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:37.950291 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:37.950339 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:37.951221 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.951705 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.953008 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.953307 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.953395 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:37.955543 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:37.955544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:37.955544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:37.955552 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:37.957101 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:37.957513 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:37.957515 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:37.957515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:37.957592 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:37.957845 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:37.957846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:37.957846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:37.957962 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:37.958030 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:37.958312 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 21:01:37.958397 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:01:37.958751 24322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:37.948647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:41727 (local address 127.14.146.194:36925)
0808 21:01:37.948820 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:37.948863 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:37.950168 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:37.950407 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:37.950412 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:37.950843 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:37.951122 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:37.951129 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.951803 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.951804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:37.952912 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:37.952916 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:37.953410 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:37.953411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:37.953533 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:37.954100 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:37.954109 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:37.955442 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:37.957189 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:37.957196 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:37.957198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:37.957424 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:37.957662 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:37.957662 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:37.957663 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:37.957774 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:37.958033 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:37.958040 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:37.958176 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 21:01:37.958278 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 21:01:37.958436 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
I20260808 21:01:37.959288 24320 heartbeater.cc:347] Connected to a master server at 127.14.146.254:41727
I20260808 21:01:37.959388 24320 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:37.959532 24320 heartbeater.cc:511] Master 127.14.146.254:41727 requested a full tablet report, sending...
I20260808 21:01:37.959911 23813 ts_manager.cc:194] Registered new tserver with Master: 4726efce93d24ae4aad6c967537b49f4 (127.14.146.194:44107)
I20260808 21:01:37.960352 23813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:36925
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:37.975893 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41727
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:33341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:38.058337 24326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:38.058538 24326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:38.058561 24326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:38.059635 24326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:38.059672 24326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:38.059698 24326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:38.061201 24326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:33341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:38.061394 24326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:38.061560 24326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:38.066581 24332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:38.066593 24333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:38.066578 24337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:38.066824 24326 server_base.cc:1034] running on GCE node
I20260808 21:01:38.067008 24326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:38.067265 24326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:38.068408 24326 hybrid_clock.cc:648] HybridClock initialized: now 1786222898068401 us; error 37 us; skew 500 ppm
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:38.070909 24326 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:38.071359 24326 webserver.cc:460] Webserver started at http://127.14.146.195:37407/ using document root <none> and password file <none>
I20260808 21:01:38.071574 24326 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:38.071638 24326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:38.071808 24326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:38.072880 24326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "d577ac14ecf44127bbb143b36bfb1f05"
format_stamp: "Formatted at 2026-08-08 21:01:38 on dist-test-slave-t3q3"
server_key: "a2cb02f97e3956ea89378dfdea15449b"
server_key_iv: "4b6af62c3304e47060582fe67c96167a"
server_key_version: "encryptionkey@0"
I20260808 21:01:38.073253 24326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "d577ac14ecf44127bbb143b36bfb1f05"
format_stamp: "Formatted at 2026-08-08 21:01:38 on dist-test-slave-t3q3"
server_key: "a2cb02f97e3956ea89378dfdea15449b"
server_key_iv: "4b6af62c3304e47060582fe67c96167a"
server_key_version: "encryptionkey@0"
I20260808 21:01:38.074621 24326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:01:38.075338 24345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:38.075503 24326 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:38.075605 24326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "d577ac14ecf44127bbb143b36bfb1f05"
format_stamp: "Formatted at 2026-08-08 21:01:38 on dist-test-slave-t3q3"
server_key: "a2cb02f97e3956ea89378dfdea15449b"
server_key_iv: "4b6af62c3304e47060582fe67c96167a"
server_key_version: "encryptionkey@0"
I20260808 21:01:38.075690 24326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:38.101511 24326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:38.103995 24326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:38.104214 24326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:38.104485 24326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:38.104822 24326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:38.104880 24326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:38.104921 24326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:38.104950 24326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:38.111444 24326 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:44405
I20260808 21:01:38.111501 24520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:44405 every 8 connection(s)
I20260808 21:01:38.111987 24326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:38.121529 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 24326
I20260808 21:01:38.121605 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:38.121827 14923 external_mini_cluster.cc:1428] Setting key 88e128d354137cc0a31da7d7c03f6eb1
I20260808 21:01:38.122424 23872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:38.113002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:53009 (local address 127.14.146.254:41727)
0808 21:01:38.113054 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:38.113056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:38.113331 (+ 275us) server_negotiation.cc:407] Connection header received
0808 21:01:38.114321 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:38.114323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:38.114337 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:38.114402 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:38.115216 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.115823 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.116933 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.117132 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.117247 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:38.119596 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:38.119597 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:38.119598 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:38.119606 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:38.120931 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:38.121368 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:38.121369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:38.121369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:38.121422 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:38.121726 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:38.121728 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:38.121728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:38.121849 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:38.121926 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:38.122238 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 21:01:38.122334 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:01:38.122685 24523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:38.112964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:41727 (local address 127.14.146.195:53009)
0808 21:01:38.113185 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:38.113242 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:38.114197 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:38.114480 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:38.114484 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:38.114874 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:38.115110 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:38.115115 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.115923 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.115924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:38.116824 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:38.116827 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.117258 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.117259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:38.117391 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:38.117917 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:38.117926 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:38.119488 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:38.121020 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:38.121028 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:38.121030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:38.121260 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:38.121500 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:38.121501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:38.121501 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:38.121652 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:38.121930 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:38.121937 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:38.122103 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 21:01:38.122217 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 21:01:38.122377 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":109,"threads_started":1}
I20260808 21:01:38.123138 24521 heartbeater.cc:347] Connected to a master server at 127.14.146.254:41727
I20260808 21:01:38.123224 24521 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:38.123436 24521 heartbeater.cc:511] Master 127.14.146.254:41727 requested a full tablet report, sending...
I20260808 21:01:38.123821 23813 ts_manager.cc:194] Registered new tserver with Master: d577ac14ecf44127bbb143b36bfb1f05 (127.14.146.195:44405)
I20260808 21:01:38.124287 23813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:53009
I20260808 21:01:38.133589 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/test-admin.keytab.
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:38.150802 14923 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 21:01:38.152643 24533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:38.151764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44698 (local address 127.14.146.193:45415)
0808 21:01:38.151949 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:38.151953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:38.151963 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:38.151991 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:38.151993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:38.152008 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:38.152153 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:38.152542 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44698: BlockingRecv error: recv got EOF from 127.0.0.1:44698 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
W20260808 21:01:38.152707 14923 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5cc' of type FILE
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:38.153789 14923 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:38.154685 14923 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:38.162916 24533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:38.155199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44712 (local address 127.14.146.193:45415)
0808 21:01:38.155267 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:38.155269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:38.155321 (+ 52us) server_negotiation.cc:407] Connection header received
0808 21:01:38.155388 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:38.155389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:38.155402 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:38.155477 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:38.155888 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.156777 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.157562 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.157974 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.158059 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:38.160202 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:38.160213 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:38.160214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:38.160223 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:38.161662 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:38.162055 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:38.162065 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:38.162066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:38.162121 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:38.162336 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:38.162337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:38.162338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:38.162486 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:38.162658 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:38.162714 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 21:01:38.162796 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 21:01:38.165023 24533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:38.164259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.14.146.193:45415)
0808 21:01:38.164321 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:38.164323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:38.164405 (+ 82us) server_negotiation.cc:407] Connection header received
0808 21:01:38.164483 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:38.164484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:38.164496 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:38.164553 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:38.164972 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44726: BlockingRecv error: recv got EOF from 127.0.0.1:44726 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 21:01:38.165102 14923 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5cc' of type FILE
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:38.166090 14923 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:38.166942 14923 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:38.174630 24533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:38.167435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44734 (local address 127.14.146.193:45415)
0808 21:01:38.167496 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:38.167498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:38.167524 (+ 26us) server_negotiation.cc:407] Connection header received
0808 21:01:38.167601 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:38.167602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:38.167610 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:38.167656 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:38.168041 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.168595 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.169305 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.169522 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.169603 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:38.171763 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:38.171764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:38.171764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:38.171772 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:38.173365 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:38.173769 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:38.173770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:38.173771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:38.173852 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:38.174081 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:38.174083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:38.174083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:38.174193 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:38.174313 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:38.174443 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 21:01:38.174528 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 21:01:38.176345 24533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:38.175727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44750 (local address 127.14.146.193:45415)
0808 21:01:38.175786 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:38.175788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:38.175844 (+ 56us) server_negotiation.cc:407] Connection header received
0808 21:01:38.175909 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:38.175910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:38.175920 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:38.175975 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:38.176295 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44750: BlockingRecv error: recv got EOF from 127.0.0.1:44750 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 21:01:38.176519 14923 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786222870463854-14923-0/krb5kdc/krb5cc)
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:38.177521 14923 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:38.178462 14923 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[23759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:01:38.186401 24533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:38.179126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44756 (local address 127.14.146.193:45415)
0808 21:01:38.179173 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:38.179175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:38.179220 (+ 45us) server_negotiation.cc:407] Connection header received
0808 21:01:38.179281 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:38.179282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:38.179290 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:38.179343 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:38.179734 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.180311 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.181057 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:38.181250 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:38.181306 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:38.183348 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:38.183349 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:38.183349 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:38.183357 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:38.184965 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:38.185577 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:38.185578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:38.185579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:38.185647 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:38.185889 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:38.185890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:38.185891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:38.185998 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:38.186105 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:38.186221 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 21:01:38.186300 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:01:38.187186 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 23907
I20260808 21:01:38.200711 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 24129
I20260808 21:01:38.223529 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 24326
I20260808 21:01:38.239377 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 23776
2026-08-08T21:01:38Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2171 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[24555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[24555](info): set up 2 sockets
Aug 08 21:01:38 dist-test-slave-t3q3 krb5kdc[24555](info): commencing operation
krb5kdc: starting...
W20260808 21:01:39.501987 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:39 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:39Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.254.keytab.
Entry for principal oryx/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.254.keytab.
I20260808 21:01:39.625130 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:40719
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.254.keytab
--principal=oryx/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:40719
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:39.708837 24578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:39.709103 24578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:39.709146 24578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:39.710323 24578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:39.710400 24578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:39.710428 24578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:39.710460 24578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:39.710494 24578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:39.712013 24578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:40719
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.254.keytab
--principal=oryx/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:40719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:39.712296 24578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:39.712487 24578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:39.717483 24589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:39.717520 24586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:39.717496 24587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:39.717845 24578 server_base.cc:1034] running on GCE node
I20260808 21:01:39.718103 24578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:39.718402 24578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:39.719545 24578 hybrid_clock.cc:648] HybridClock initialized: now 1786222899719534 us; error 27 us; skew 500 ppm
Aug 08 21:01:39 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:39.725649 24578 init.cc:377] Logged in from keytab as oryx/127.14.146.254@KRBTEST.COM (short username oryx)
I20260808 21:01:39.726145 24578 webserver.cc:460] Webserver started at http://127.14.146.254:42617/ using document root <none> and password file <none>
I20260808 21:01:39.726406 24578 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:39.726452 24578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:39.726627 24578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:39.727742 24578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "aa156e781c1947b88022c59341a60bd8"
format_stamp: "Formatted at 2026-08-08 21:01:39 on dist-test-slave-t3q3"
server_key: "9cb5f60773f5d3532baae7b19890b00d"
server_key_iv: "0a877a459ec09e29d2a26a8c2cdc4e55"
server_key_version: "encryptionkey@0"
I20260808 21:01:39.728173 24578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "aa156e781c1947b88022c59341a60bd8"
format_stamp: "Formatted at 2026-08-08 21:01:39 on dist-test-slave-t3q3"
server_key: "9cb5f60773f5d3532baae7b19890b00d"
server_key_iv: "0a877a459ec09e29d2a26a8c2cdc4e55"
server_key_version: "encryptionkey@0"
I20260808 21:01:39.729553 24578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:39.730257 24604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:39.730473 24578 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:39.730574 24578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "aa156e781c1947b88022c59341a60bd8"
format_stamp: "Formatted at 2026-08-08 21:01:39 on dist-test-slave-t3q3"
server_key: "9cb5f60773f5d3532baae7b19890b00d"
server_key_iv: "0a877a459ec09e29d2a26a8c2cdc4e55"
server_key_version: "encryptionkey@0"
I20260808 21:01:39.730641 24578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:39.737772 24578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:39.739987 24578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:39.740164 24578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:39.744107 24578 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:40719
I20260808 21:01:39.744167 24691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:40719 every 8 connection(s)
I20260808 21:01:39.744535 24578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:39.745550 24692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:39.747802 24692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: Bootstrap starting.
I20260808 21:01:39.748454 24692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:39.748740 24692 log.cc:824] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:39.749454 24692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: No bootstrap required, opened a new log
I20260808 21:01:39.750182 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 24578
I20260808 21:01:39.750289 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:39.750497 14923 external_mini_cluster.cc:1428] Setting key b69fdc2d59dff9790180cd9bb2ba9a27
I20260808 21:01:39.752223 24692 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } }
I20260808 21:01:39.752401 24692 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:39.752460 24692 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa156e781c1947b88022c59341a60bd8, State: Initialized, Role: FOLLOWER
I20260808 21:01:39.752601 24692 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } }
I20260808 21:01:39.752694 24692 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:39.752733 24692 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:39.752787 24692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:39.753474 24692 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } }
I20260808 21:01:39.753567 24692 leader_election.cc:302] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa156e781c1947b88022c59341a60bd8; no voters:
I20260808 21:01:39.753778 24692 leader_election.cc:288] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:39.753809 24702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:39.753935 24702 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 1 LEADER]: Becoming Leader. State: Replica: aa156e781c1947b88022c59341a60bd8, State: Running, Role: LEADER
I20260808 21:01:39.754055 24692 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:39.754025 24702 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } }
I20260808 21:01:39.754407 24702 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa156e781c1947b88022c59341a60bd8. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } }
I20260808 21:01:39.754484 24702 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:39.754448 24705 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } }
I20260808 21:01:39.754868 24705 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:39.755264 24711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:39.755817 24711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:39.758237 24711 catalog_manager.cc:1347] Generated new cluster ID: 1df742c27eb84037968c901cf683f006
I20260808 21:01:39.758294 24711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:01:39 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:39.762143 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:39.751027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38218 (local address 127.14.146.254:40719)
0808 21:01:39.751212 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:39.751222 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:39.751249 (+ 27us) server_negotiation.cc:407] Connection header received
0808 21:01:39.752155 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:39.752168 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:39.752222 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:39.752336 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:39.753180 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:39.754372 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:39.755441 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:39.756034 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:39.756216 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:39.758935 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:39.758939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:39.758939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:39.758950 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:39.760681 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:39.761062 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:39.761065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:39.761066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:39.761154 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:39.761377 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:39.761378 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:39.761378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:39.761604 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:39.761775 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:39.761853 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 21:01:39.761988 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260808 21:01:39.765578 24711 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:39.766072 24711 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:39.779551 24711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: Generated new TSK 0
I20260808 21:01:39.779755 24711 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab.
Entry for principal oryx/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab.
I20260808 21:01:39.815101 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40719
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab
--principal=oryx/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:39.912165 24741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:39.912371 24741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:39.912395 24741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:39.913503 24741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:39.913542 24741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:39.913566 24741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:39.915081 24741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab
--principal=oryx/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:39.915290 24741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:39.915467 24741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:39.920511 24753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:39.920610 24741 server_base.cc:1034] running on GCE node
W20260808 21:01:39.920496 24755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:39.920483 24750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:39.920949 24741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:39.921200 24741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:39.922371 24741 hybrid_clock.cc:648] HybridClock initialized: now 1786222899922360 us; error 31 us; skew 500 ppm
Aug 08 21:01:39 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:39.924911 24741 init.cc:377] Logged in from keytab as oryx/127.14.146.193@KRBTEST.COM (short username oryx)
I20260808 21:01:39.925406 24741 webserver.cc:460] Webserver started at http://127.14.146.193:38933/ using document root <none> and password file <none>
I20260808 21:01:39.925631 24741 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:39.925699 24741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:39.925865 24741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:39.926978 24741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c"
format_stamp: "Formatted at 2026-08-08 21:01:39 on dist-test-slave-t3q3"
server_key: "ece434692bd242b7719b2b7c068b12f3"
server_key_iv: "c6ea64a117f6dbd52422d0d568c20a55"
server_key_version: "encryptionkey@0"
I20260808 21:01:39.927356 24741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c"
format_stamp: "Formatted at 2026-08-08 21:01:39 on dist-test-slave-t3q3"
server_key: "ece434692bd242b7719b2b7c068b12f3"
server_key_iv: "c6ea64a117f6dbd52422d0d568c20a55"
server_key_version: "encryptionkey@0"
I20260808 21:01:39.928761 24741 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 21:01:39.929483 24768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:39.929651 24741 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:39.929761 24741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c"
format_stamp: "Formatted at 2026-08-08 21:01:39 on dist-test-slave-t3q3"
server_key: "ece434692bd242b7719b2b7c068b12f3"
server_key_iv: "c6ea64a117f6dbd52422d0d568c20a55"
server_key_version: "encryptionkey@0"
I20260808 21:01:39.929834 24741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:39.941329 24741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:39.943123 24741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:39.943291 24741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:39.943526 24741 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:39.943835 24741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:39.943887 24741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:39.943928 24741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:39.943953 24741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:39.949913 24741 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:34723
I20260808 21:01:39.949954 24941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:34723 every 8 connection(s)
I20260808 21:01:39.950306 24741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:39.951781 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 24741
I20260808 21:01:39.951901 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:39.952137 14923 external_mini_cluster.cc:1428] Setting key c6ce1e4301f8689d5bb101562ca138d9
Aug 08 21:01:39 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:39.960988 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:39.951081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:58301 (local address 127.14.146.254:40719)
0808 21:01:39.951126 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:39.951128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:39.951319 (+ 191us) server_negotiation.cc:407] Connection header received
0808 21:01:39.951836 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:39.951837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:39.951850 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:39.951902 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:39.953132 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:39.953709 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:39.954859 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:39.955082 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:39.955180 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:39.957855 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:39.957856 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:39.957856 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:39.957863 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:39.959263 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:39.959790 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:39.959791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:39.959792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:39.959888 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:39.960238 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:39.960239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:39.960239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:39.960358 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:39.960418 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:39.960836 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 21:01:39.960919 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:39.961181 24945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:39.951034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:58301)
0808 21:01:39.951195 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:39.951235 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:39.951716 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:39.952005 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:39.952009 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:39.952741 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:39.953027 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:39.953033 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:39.953807 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:39.953808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:39.954776 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:39.954778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:39.955198 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:39.955199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:39.955340 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:39.955908 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:39.955916 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:39.957744 (+ 1828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:39.959348 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:39.959357 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:39.959359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:39.959680 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:39.959969 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:39.959970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:39.959971 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:39.960143 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:39.960436 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:39.960444 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:39.960614 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 21:01:39.960739 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 21:01:39.960915 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":97,"threads_started":1}
I20260808 21:01:39.961814 24943 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40719
I20260808 21:01:39.961937 24943 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:01:39.962136 24943 heartbeater.cc:511] Master 127.14.146.254:40719 requested a full tablet report, sending...
I20260808 21:01:39.962659 24630 ts_manager.cc:194] Registered new tserver with Master: d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723)
I20260808 21:01:39.963336 24630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:58301
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab.
Entry for principal oryx/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab.
I20260808 21:01:39.979293 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40719
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab
--principal=oryx/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:40.062258 24949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:40.062456 24949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:40.062480 24949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:40.063519 24949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:40.063553 24949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:40.063578 24949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:40.065066 24949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab
--principal=oryx/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:40.065263 24949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:40.065430 24949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:40.070312 24958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.070346 24956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.070415 24955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:40.070752 24949 server_base.cc:1034] running on GCE node
I20260808 21:01:40.070999 24949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:40.071203 24949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:40.072340 24949 hybrid_clock.cc:648] HybridClock initialized: now 1786222900072280 us; error 78 us; skew 500 ppm
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:40.074932 24949 init.cc:377] Logged in from keytab as oryx/127.14.146.194@KRBTEST.COM (short username oryx)
I20260808 21:01:40.075361 24949 webserver.cc:460] Webserver started at http://127.14.146.194:34989/ using document root <none> and password file <none>
I20260808 21:01:40.075557 24949 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:40.075596 24949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:40.075718 24949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:40.076761 24949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "eb9ebcfd392c443c8fb57360332ceef5"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "a7344438c64db8c78f823afd4d91bb14"
server_key_iv: "95f7e6603e3b48f389505e30f3670838"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.077062 24949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "eb9ebcfd392c443c8fb57360332ceef5"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "a7344438c64db8c78f823afd4d91bb14"
server_key_iv: "95f7e6603e3b48f389505e30f3670838"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.078294 24949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:01:40.078961 24972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.079150 24949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:40.079241 24949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "eb9ebcfd392c443c8fb57360332ceef5"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "a7344438c64db8c78f823afd4d91bb14"
server_key_iv: "95f7e6603e3b48f389505e30f3670838"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.079296 24949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:40.099407 24949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:40.101271 24949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:40.101387 24949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:40.101572 24949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:40.101912 24949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:40.101946 24949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.101969 24949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:40.102018 24949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.107756 24949 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:35485
I20260808 21:01:40.107796 25132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:35485 every 8 connection(s)
I20260808 21:01:40.108150 24949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:40.114710 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 24949
I20260808 21:01:40.114835 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:40.115028 14923 external_mini_cluster.cc:1428] Setting key 8d1e6e12ec6792eda5a810d767bb913e
I20260808 21:01:40.117697 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.108894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:33233 (local address 127.14.146.254:40719)
0808 21:01:40.108980 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.108983 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.109131 (+ 148us) server_negotiation.cc:407] Connection header received
0808 21:01:40.109597 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.109599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.109609 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.109661 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.110561 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.111069 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.112016 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.112265 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.112320 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.114408 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.114409 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.114409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.114415 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.116181 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.116592 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.116594 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.116594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.116654 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.116967 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.116968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.116969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.117130 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.117208 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.117464 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.117563 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 21:01:40.117715 25137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.108838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:33233)
0808 21:01:40.109015 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.109051 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.109516 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.109741 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.109744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.110295 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.110485 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.110489 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.111146 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.111147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.111941 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.111943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.112334 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.112335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.112444 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.112957 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.112965 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.114328 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.116269 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.116277 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.116279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.116500 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.116742 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.116743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.116744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.116862 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.117209 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.117214 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.117329 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.117415 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.117528 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260808 21:01:40.118288 25134 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40719
I20260808 21:01:40.118393 25134 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:40.118584 25134 heartbeater.cc:511] Master 127.14.146.254:40719 requested a full tablet report, sending...
I20260808 21:01:40.118939 24630 ts_manager.cc:194] Registered new tserver with Master: eb9ebcfd392c443c8fb57360332ceef5 (127.14.146.194:35485)
I20260808 21:01:40.119341 24630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:33233
WARNING: no policy specified for oryx/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab.
Entry for principal oryx/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab.
I20260808 21:01:40.142351 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40719
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab
--principal=oryx/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:40.223960 25142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:40.224208 25142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:40.224233 25142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:40.225381 25142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:40.225425 25142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:40.225451 25142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:40.226904 25142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab
--principal=oryx/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:40719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:40.227169 25142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:40.227407 25142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:40.232546 25156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.232555 25148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.232565 25149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:40.232885 25142 server_base.cc:1034] running on GCE node
I20260808 21:01:40.233152 25142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:40.233397 25142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:40.234586 25142 hybrid_clock.cc:648] HybridClock initialized: now 1786222900234580 us; error 40 us; skew 500 ppm
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:40.237401 25142 init.cc:377] Logged in from keytab as oryx/127.14.146.195@KRBTEST.COM (short username oryx)
I20260808 21:01:40.237887 25142 webserver.cc:460] Webserver started at http://127.14.146.195:38437/ using document root <none> and password file <none>
I20260808 21:01:40.238174 25142 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:40.238225 25142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:40.238380 25142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:40.239450 25142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "fe20b63df900425dba5c9d915078d26c"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "48f99269a05d85bef78b847f55c10631"
server_key_iv: "4adfa014028f9621bf20aaecb2958dc9"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.239833 25142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "fe20b63df900425dba5c9d915078d26c"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "48f99269a05d85bef78b847f55c10631"
server_key_iv: "4adfa014028f9621bf20aaecb2958dc9"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.241446 25142 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:40.242267 25164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.242458 25142 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:40.242563 25142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "fe20b63df900425dba5c9d915078d26c"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "48f99269a05d85bef78b847f55c10631"
server_key_iv: "4adfa014028f9621bf20aaecb2958dc9"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.242641 25142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:40.264570 25142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:40.267027 25142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:40.267189 25142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:40.267457 25142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:40.267781 25142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:40.267815 25142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.267869 25142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:40.267899 25142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.274142 25142 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:37367
I20260808 21:01:40.274186 25338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:37367 every 8 connection(s)
I20260808 21:01:40.274533 25142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:40.277575 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 25142
I20260808 21:01:40.277683 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:40.277850 14923 external_mini_cluster.cc:1428] Setting key 62d3b8438a77af94dda1ae557feb2c1b
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:40.284556 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.275279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:52877 (local address 127.14.146.254:40719)
0808 21:01:40.275350 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.275353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.275631 (+ 278us) server_negotiation.cc:407] Connection header received
0808 21:01:40.276216 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.276217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.276227 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.276283 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.277271 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.277883 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.279224 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.279429 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.279491 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.281853 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.281855 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.281855 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.281862 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.283202 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.283627 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.283627 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.283628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.283680 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.283937 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.283937 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.283938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.284092 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.284154 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.284424 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.284488 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:01:40.284749 25345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.275264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:52877)
0808 21:01:40.275454 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.275518 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.276053 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.276340 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.276344 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.276944 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.277167 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.277172 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.278011 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.278012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.279142 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.279145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.279543 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.279544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.279709 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.280341 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.280350 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.281766 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.283301 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.283307 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.283309 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.283558 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.283739 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.283740 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.283740 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.283865 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.284178 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.284183 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.284309 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.284396 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.284535 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":110,"threads_started":1}
I20260808 21:01:40.285229 25342 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40719
I20260808 21:01:40.285321 25342 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:40.285473 25342 heartbeater.cc:511] Master 127.14.146.254:40719 requested a full tablet report, sending...
I20260808 21:01:40.285852 24630 ts_manager.cc:194] Registered new tserver with Master: fe20b63df900425dba5c9d915078d26c (127.14.146.195:37367)
I20260808 21:01:40.286235 24630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:52877
I20260808 21:01:40.289732 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.146.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.253.keytab.
Entry for principal oryx/127.14.146.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.253.keytab.
I20260808 21:01:40.319389 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.253:39823
--webserver_interface=127.14.146.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.253.keytab
--principal=oryx/127.14.146.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:40719,127.14.146.253:39823
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:40.405076 25351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:40.405303 25351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:40.405326 25351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:40.406492 25351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:40.406538 25351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:40.406551 25351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:40.406564 25351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:40.406576 25351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:40.408100 25351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:40719,127.14.146.253:39823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.253.keytab
--principal=oryx/127.14.146.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.253:39823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.146.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
W20260808 21:01:40.408234 25351 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.14.146.254:40719,127.14.146.253:39823'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 21:01:40.408386 25351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:40.408627 25351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:40.413733 25357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.414855 25360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.414991 25358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:40.415628 25351 server_base.cc:1034] running on GCE node
I20260808 21:01:40.415884 25351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:40.416247 25351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:40.417438 25351 hybrid_clock.cc:648] HybridClock initialized: now 1786222900417430 us; error 36 us; skew 500 ppm
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:40.419982 25351 init.cc:377] Logged in from keytab as oryx/127.14.146.253@KRBTEST.COM (short username oryx)
I20260808 21:01:40.420437 25351 webserver.cc:460] Webserver started at http://127.14.146.253:41033/ using document root <none> and password file <none>
I20260808 21:01:40.420663 25351 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:40.420739 25351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:40.420892 25351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:40.421969 25351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data/instance:
uuid: "c7c34cf35a614be3899aefa168b2f13b"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "799c0180a609cb7311a9cbf856fd2017"
server_key_iv: "2e173cdbaf04e3360a41a7f684d0675d"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.422336 25351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal/instance:
uuid: "c7c34cf35a614be3899aefa168b2f13b"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "799c0180a609cb7311a9cbf856fd2017"
server_key_iv: "2e173cdbaf04e3360a41a7f684d0675d"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.423722 25351 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:40.424530 25373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.424728 25351 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:40.424840 25351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
uuid: "c7c34cf35a614be3899aefa168b2f13b"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "799c0180a609cb7311a9cbf856fd2017"
server_key_iv: "2e173cdbaf04e3360a41a7f684d0675d"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.424913 25351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:40.450373 25351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:40.452421 25351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:40.452584 25351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:40.456678 25351 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.253:39823
I20260808 21:01:40.456719 25444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.253:39823 every 8 connection(s)
I20260808 21:01:40.457094 25351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
I20260808 21:01:40.458155 25448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:40.459658 25448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.253@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:40.465939 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 25351
I20260808 21:01:40.468986 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.460370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38222 (local address 127.14.146.254:40719)
0808 21:01:40.460437 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.460439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.460660 (+ 221us) server_negotiation.cc:407] Connection header received
0808 21:01:40.461152 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.461153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.461165 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.461219 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.461851 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.462368 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.463406 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.463611 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.463687 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.465885 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.465886 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.465886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.465895 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.467485 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.467959 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.467960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.467961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.468024 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.468316 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.468316 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.468317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.468515 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.468587 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.468829 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.468921 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 21:01:40.469174 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.460335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38222)
0808 21:01:40.460544 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.460578 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.461041 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.461291 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.461294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.461561 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.461753 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.461759 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.462485 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.462486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.463313 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.463315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.463706 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.463707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.463830 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.464376 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.464385 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.465788 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.467566 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.467573 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.467575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.467889 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.468144 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.468144 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.468145 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.468250 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.468584 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.468588 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.468698 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.468778 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.468941 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":100,"threads_started":1}
I20260808 21:01:40.469805 25448 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.146.253@KRBTEST.COM
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.253@KRBTEST.COM for oryx/127.14.146.253@KRBTEST.COM
I20260808 21:01:40.476127 25456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.466583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58108 (local address 127.14.146.253:39823)
0808 21:01:40.466762 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.466767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.467001 (+ 234us) server_negotiation.cc:407] Connection header received
0808 21:01:40.467060 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.467063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.467079 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.467174 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.467802 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.468791 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.469729 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.470063 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.470154 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.472972 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.472980 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.472981 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.472998 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.474840 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.475168 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.475172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.475173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.475247 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.475432 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.475433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.475433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.475615 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.475780 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.475892 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.475981 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":113,"threads_started":1}
I20260808 21:01:40.477474 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.470100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.0.0.1:58114)
0808 21:01:40.470142 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.470151 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.470189 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.470423 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.470424 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.470571 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.470626 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.470628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.471595 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.471596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.472047 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.472048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.472570 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.472571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.472646 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.473083 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.473087 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.474277 (+ 1190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.476710 (+ 2433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.476711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.476712 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.476910 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.477076 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.477076 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.477077 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.477126 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.477279 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.477280 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.477309 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.477354 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.477422 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 21:01:40.477594 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.470151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.14.146.253:39823)
0808 21:01:40.470290 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.470292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.470299 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:01:40.470316 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.470317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.470327 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.470402 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.470703 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.471514 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.472155 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.472488 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.472557 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.474357 (+ 1800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.474358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.474358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.474365 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.476598 (+ 2233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.476960 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.476961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.476961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.477011 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.477163 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.477164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.477164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.477245 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.477288 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.477367 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.477466 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260808 21:01:40.478788 25448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Bootstrap starting.
I20260808 21:01:40.479378 25448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:40.479647 25448 log.cc:824] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:40.480386 25448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: No bootstrap required, opened a new log
I20260808 21:01:40.481815 25448 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } }
I20260808 21:01:40.481952 25448 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:40.481999 25448 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c34cf35a614be3899aefa168b2f13b, State: Initialized, Role: FOLLOWER
I20260808 21:01:40.482134 25448 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } }
I20260808 21:01:40.482420 25448 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:40.482384 25461 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } } }
I20260808 21:01:40.482566 25461 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: This master's current role is: FOLLOWER
W20260808 21:01:40.484052 25477 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:01:40.484133 25477 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:01:40.485772 25351 master_runner.cc:428] Detected that this master c7c34cf35a614be3899aefa168b2f13b is joining an existing cluster
I20260808 21:01:40.485857 25351 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.146.253:39823
I20260808 21:01:40.493817 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.486826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38230 (local address 127.14.146.254:40719)
0808 21:01:40.486866 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.486867 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.486990 (+ 123us) server_negotiation.cc:407] Connection header received
0808 21:01:40.487094 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.487096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.487107 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.487170 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.487699 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.488493 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.489478 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.489789 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.489862 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.491040 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.491041 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.491042 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.491048 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.492611 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.493015 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.493016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.493017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.493078 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.493252 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.493253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.493254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.493390 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.493459 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.493652 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.493723 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:01:40.493984 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.486941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.0.0.1:58130)
0808 21:01:40.487059 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.487069 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.487120 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.487236 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.487237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.487513 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.487612 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.487614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.488313 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.488314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.489063 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.489065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.489543 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.489543 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.489581 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.490134 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.490138 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.490478 (+ 340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.492536 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.492537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.492538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.492795 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.493163 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.493163 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.493164 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.493235 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.493476 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.493476 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.493520 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.493672 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.493894 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":151,"thread_start_us":81,"threads_started":1}
I20260808 21:01:40.494231 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.486864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58130 (local address 127.14.146.253:39823)
0808 21:01:40.486897 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.486899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.487109 (+ 210us) server_negotiation.cc:407] Connection header received
0808 21:01:40.487169 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.487170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.487177 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.487223 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.487706 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.488250 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.489146 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.489443 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.489480 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.490579 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.490580 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.490581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.490587 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.492440 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.492872 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.492874 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.492874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.492926 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.493288 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.493288 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.493289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.493404 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.493466 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.493646 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.493805 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":18}
I20260808 21:01:40.493835 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.486788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38230)
0808 21:01:40.486935 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.486945 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.487002 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.487256 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.487256 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.487518 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.487612 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.487614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.488587 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.488588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.489396 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.489398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.489872 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.489873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.489957 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.490626 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.490630 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.490971 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.492697 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.492699 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.492699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.492928 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.493134 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.493134 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.493134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.493178 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.493487 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.493488 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.493525 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.493610 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.493736 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":15,"thread_start_us":97,"threads_started":1}
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.254@KRBTEST.COM for oryx/127.14.146.253@KRBTEST.COM
I20260808 21:01:40.503335 25457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.496490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58136 (local address 127.14.146.253:39823)
0808 21:01:40.496529 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.496531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.496681 (+ 150us) server_negotiation.cc:407] Connection header received
0808 21:01:40.496743 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.496744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.496753 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.496818 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.497149 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.497840 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.498556 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.498837 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.498904 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.500988 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.500989 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.500990 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.500995 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.502212 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.502659 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.502660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.502660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.502711 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.502906 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.502907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.502907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.502994 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.503041 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.503231 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.503284 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 21:01:40.503428 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.496437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.0.0.1:58136)
0808 21:01:40.496555 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.496610 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.496685 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.496821 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.496823 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.497042 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.497083 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.497085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.497915 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.497916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.498475 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.498477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.498910 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.498910 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.498975 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.499385 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.499388 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.500908 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.502294 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.502302 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.502304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.502579 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.502774 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.502775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.502775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.502844 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.503057 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.503064 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.503116 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.503205 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.503318 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":76,"threads_started":1}
I20260808 21:01:40.504007 24630 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.146.253:39823: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b"
member_type: NON_VOTER
last_known_addr {
host: "127.14.146.253"
port: 39823
}
attrs {
promote: true
}
}
dest_uuid: "aa156e781c1947b88022c59341a60bd8"
cas_config_opid_index: -1
I20260808 21:01:40.504405 24630 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } }
I20260808 21:01:40.504920 25489 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER c7c34cf35a614be3899aefa168b2f13b (127.14.146.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } }
I20260808 21:01:40.505183 25410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:40.505837 25489 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.146.253:39823
I20260808 21:01:40.506091 25410 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Refusing update from remote peer aa156e781c1947b88022c59341a60bd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 21:01:40.506111 25351 master.cc:537] Master@127.14.146.253:39823 shutting down...
I20260808 21:01:40.506111 25487 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } }
I20260808 21:01:40.506189 25487 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:40.506742 25487 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 21:01:40.507426 24610 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 21:01:40.507882 24610 consensus_peers.cc:487] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 -> Peer c7c34cf35a614be3899aefa168b2f13b (127.14.146.253:39823): Couldn't send request to peer c7c34cf35a614be3899aefa168b2f13b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 21:01:40.509778 25351 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:40.509894 25351 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:40.509946 25351 tablet_replica.cc:330] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: stopping tablet replica
I20260808 21:01:40.522713 25351 master.cc:552] Master@127.14.146.253:39823 shutdown complete.
I20260808 21:01:40.522780 25351 master_runner.cc:305] Clearing existing system tablet
I20260808 21:01:40.522907 25351 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:40.522970 25351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:40.523566 25351 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:40.524091 25495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.524219 25351 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:40.524277 25351 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.524320 25351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
uuid: "c7c34cf35a614be3899aefa168b2f13b"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "799c0180a609cb7311a9cbf856fd2017"
server_key_iv: "2e173cdbaf04e3360a41a7f684d0675d"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.525480 25351 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:40.526854 25351 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 21:01:40.526912 25351 log.cc:1196] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 21:01:40.527123 25351 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Deleting consensus metadata
I20260808 21:01:40.527276 25351 master_runner.cc:315] Copying system tablet from 127.14.146.254:40719
I20260808 21:01:40.527925 25351 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: tablet copy: Beginning tablet copy session from remote peer at address 127.14.146.254:40719
I20260808 21:01:40.535107 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.528362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38236 (local address 127.14.146.254:40719)
0808 21:01:40.528415 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.528418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.528514 (+ 96us) server_negotiation.cc:407] Connection header received
0808 21:01:40.528600 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.528601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.528609 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.528658 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.529017 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.529505 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.530546 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.530725 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.530774 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.531939 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.531941 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.531941 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.531949 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.533998 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.534448 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.534450 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.534450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.534520 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.534706 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.534707 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.534707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.534799 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.534845 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.534993 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.535048 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:01:40.535182 25504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.528305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38236)
0808 21:01:40.528452 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.528463 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.528539 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.528681 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.528682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.528876 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.528944 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.528946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.529583 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.529584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.530462 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.530464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.530793 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.530794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.530863 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.531425 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.531430 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.531818 (+ 388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.534111 (+ 2293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.534112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.534112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.534370 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.534588 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.534589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.534589 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.534654 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.534853 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.534853 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.534899 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.534974 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.535076 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260808 21:01:40.535593 24665 tablet_copy_service.cc:140] P aa156e781c1947b88022c59341a60bd8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c7c34cf35a614be3899aefa168b2f13b ({username='oryx', principal='oryx/127.14.146.253@KRBTEST.COM'} at 127.0.0.1:38236)
I20260808 21:01:40.535732 24665 tablet_copy_service.cc:161] P aa156e781c1947b88022c59341a60bd8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c7c34cf35a614be3899aefa168b2f13b at {username='oryx', principal='oryx/127.14.146.253@KRBTEST.COM'} at 127.0.0.1:38236: session id = c7c34cf35a614be3899aefa168b2f13b-00000000000000000000000000000000
I20260808 21:01:40.536653 24665 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 21:01:40.537230 25351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 21:01:40.538257 25351 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: tablet copy: Starting download of 0 data blocks...
I20260808 21:01:40.538419 25351 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: tablet copy: Starting download of 1 WAL segments...
I20260808 21:01:40.539263 25351 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 21:01:40.540024 24665 tablet_copy_service.cc:342] P aa156e781c1947b88022c59341a60bd8: Request end of tablet copy session c7c34cf35a614be3899aefa168b2f13b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.146.253@KRBTEST.COM'} at 127.0.0.1:38236
I20260808 21:01:40.540113 24665 tablet_copy_service.cc:433] P aa156e781c1947b88022c59341a60bd8: ending tablet copy session c7c34cf35a614be3899aefa168b2f13b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c7c34cf35a614be3899aefa168b2f13b
I20260808 21:01:40.542493 25351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:40.543637 25508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.543841 25511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:40.543866 25351 server_base.cc:1034] running on GCE node
W20260808 21:01:40.544193 25505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:40.544325 25351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:40.544492 25351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:40.545617 25351 hybrid_clock.cc:648] HybridClock initialized: now 1786222900545609 us; error 24 us; skew 500 ppm
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:40.547087 25351 init.cc:377] Logged in from keytab as oryx/127.14.146.253@KRBTEST.COM (short username oryx)
I20260808 21:01:40.547339 25351 webserver.cc:460] Webserver started at http://127.14.146.253:44643/ using document root <none> and password file <none>
I20260808 21:01:40.547453 25351 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:40.547489 25351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:40.548233 25351 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:40.548791 25525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.548931 25351 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.548985 25351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
uuid: "c7c34cf35a614be3899aefa168b2f13b"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "799c0180a609cb7311a9cbf856fd2017"
server_key_iv: "2e173cdbaf04e3360a41a7f684d0675d"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.549042 25351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:40.554466 25351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:40.556053 25351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:40.559057 25351 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.253:39823
I20260808 21:01:40.559502 25351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
I20260808 21:01:40.559614 25602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.253:39823 every 8 connection(s)
I20260808 21:01:40.560264 25603 sys_catalog.cc:263] Verifying existing consensus state
I20260808 21:01:40.560636 25603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Bootstrap starting.
I20260808 21:01:40.562920 25603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:01:40.563154 25603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: Bootstrap complete.
I20260808 21:01:40.563354 25603 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } }
I20260808 21:01:40.563418 25603 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c7c34cf35a614be3899aefa168b2f13b, State: Initialized, Role: LEARNER
I20260808 21:01:40.563443 25603 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } }
I20260808 21:01:40.563661 25603 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:40.563622 25609 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } }
I20260808 21:01:40.563714 25609 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: This master's current role is: LEARNER
I20260808 21:01:40.564996 25624 catalog_manager.cc:1259] Loaded cluster ID: 1df742c27eb84037968c901cf683f006
I20260808 21:01:40.565042 25624 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: loading cluster ID for follower catalog manager: success
I20260808 21:01:40.566243 25624 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: acquiring CA information for follower catalog manager: success
I20260808 21:01:40.566562 25624 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:01:40.584949 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.577811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58148 (local address 127.14.146.253:39823)
0808 21:01:40.577934 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.577936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.577947 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:40.577973 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.577974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.577986 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.578074 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.578616 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.579653 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.580431 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.580749 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.580825 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.582085 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.582086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.582086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.582094 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.583740 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.584093 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.584094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.584094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.584164 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.584366 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.584367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.584368 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.584508 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.584626 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.584732 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.584818 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
WARNING: no policy specified for oryx/127.14.146.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.252.keytab.
Entry for principal oryx/127.14.146.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.252.keytab.
I20260808 21:01:40.615079 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.252:33449
--webserver_interface=127.14.146.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.252.keytab
--principal=oryx/127.14.146.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:40719,127.14.146.253:39823,127.14.146.252:33449
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:40.700416 25628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:40.700666 25628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:40.700712 25628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:40.701865 25628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:40.701931 25628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:40.701956 25628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:40.701977 25628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:40.702003 25628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:40.703500 25628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:40719,127.14.146.253:39823,127.14.146.252:33449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.252.keytab
--principal=oryx/127.14.146.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.252:33449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.146.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:40.703799 25628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:40.704030 25628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:40.708992 25634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:40.709260 25628 server_base.cc:1034] running on GCE node
W20260808 21:01:40.708992 25637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.709172 25635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:40.709776 25628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:40.710150 25628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:40.711319 25628 hybrid_clock.cc:648] HybridClock initialized: now 1786222900711298 us; error 35 us; skew 500 ppm
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:40.714936 25628 init.cc:377] Logged in from keytab as oryx/127.14.146.252@KRBTEST.COM (short username oryx)
I20260808 21:01:40.715448 25628 webserver.cc:460] Webserver started at http://127.14.146.252:33655/ using document root <none> and password file <none>
I20260808 21:01:40.715706 25628 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:40.715778 25628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:40.715937 25628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:40.717293 25628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data/instance:
uuid: "235f4379fe2e4e8f98b534bfb927fe30"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "bec33a4c921b8af38521c91af0e37702"
server_key_iv: "6f96051779613c5ad273abb03b651ab7"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.717820 25628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal/instance:
uuid: "235f4379fe2e4e8f98b534bfb927fe30"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "bec33a4c921b8af38521c91af0e37702"
server_key_iv: "6f96051779613c5ad273abb03b651ab7"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.719472 25628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:01:40.720469 25644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.720666 25628 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:40.720785 25628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
uuid: "235f4379fe2e4e8f98b534bfb927fe30"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "bec33a4c921b8af38521c91af0e37702"
server_key_iv: "6f96051779613c5ad273abb03b651ab7"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.720883 25628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:40.765022 25628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:40.767025 25628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:40.767194 25628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:40.771382 25628 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.252:33449
I20260808 21:01:40.771464 25723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.252:33449 every 8 connection(s)
I20260808 21:01:40.771837 25628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
I20260808 21:01:40.772828 25724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:40.774354 25724 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.252@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:40.781739 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 25628
I20260808 21:01:40.783962 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.775152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38240 (local address 127.14.146.254:40719)
0808 21:01:40.775239 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.775241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.775409 (+ 168us) server_negotiation.cc:407] Connection header received
0808 21:01:40.775924 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.775926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.775938 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.775991 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.776651 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.777154 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.778167 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.778367 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.778456 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.780746 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.780748 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.780748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.780756 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.782375 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.782962 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.782963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.782963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.783021 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.783315 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.783316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.783316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.783421 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.783499 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.783776 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.783865 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 21:01:40.784046 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.775068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38240)
0808 21:01:40.775275 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.775325 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.775812 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.776090 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.776094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.776360 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.776552 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.776556 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.777259 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.777260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.778073 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.778075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.778475 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.778476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.778606 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.779124 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.779133 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.780654 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.782519 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.782527 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.782530 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.782878 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.783087 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.783088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.783089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.783243 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.783492 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.783499 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.783641 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.783735 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.783857 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":97,"threads_started":1}
I20260808 21:01:40.784621 25724 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.146.252@KRBTEST.COM
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.252@KRBTEST.COM for oryx/127.14.146.253@KRBTEST.COM
I20260808 21:01:40.791340 25732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.782464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41908 (local address 127.14.146.252:33449)
0808 21:01:40.782615 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.782620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.782639 (+ 19us) server_negotiation.cc:407] Connection header received
0808 21:01:40.782667 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.782669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.782679 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.782744 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.783493 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.784519 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.785476 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.785824 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.785875 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.788469 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.788483 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.788484 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.788489 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.790137 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.790494 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.790497 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.790498 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.790559 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.790772 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.790773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.790774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.790914 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.791054 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.791145 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.791220 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":96,"threads_started":1}
I20260808 21:01:40.791424 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.785118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58160 (local address 127.14.146.253:39823)
0808 21:01:40.785181 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.785183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.785191 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:40.785223 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.785225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.785237 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.785300 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.785574 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.786171 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.786865 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.787089 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.787164 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.788864 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.788865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.788866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.788873 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.790213 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.790600 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.790601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.790601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.790666 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.790873 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.790874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.790875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.791002 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.791076 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.791249 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.791329 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 21:01:40.791431 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.784891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.0.0.1:58160)
0808 21:01:40.784939 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.784950 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.784988 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.785312 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.785313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.785419 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.785492 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.785493 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.786283 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.786284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.786778 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.786780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.787164 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.787166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.787253 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.787586 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.787592 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.788775 (+ 1183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.790329 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.790330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.790331 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.790520 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.790745 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.790745 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.790746 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.790810 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.791081 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.791082 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.791126 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.791206 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.791308 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 21:01:40.791977 25724 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.252@KRBTEST.COM for oryx/127.14.146.252@KRBTEST.COM
I20260808 21:01:40.797549 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.792244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.0.0.1:41918)
0808 21:01:40.792296 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.792307 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.792357 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.792449 (+ 92us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.792449 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.792556 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.792583 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.792584 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.793144 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.793145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.793592 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.793593 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.793904 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.793905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.793943 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.794260 (+ 317us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.794264 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.795293 (+ 1029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.796776 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.796777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.796777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.796930 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.797095 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.797096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.797096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.797145 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.797313 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.797314 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.797345 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.797394 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.797463 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 21:01:40.797595 25732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.792280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41918 (local address 127.14.146.252:33449)
0808 21:01:40.792311 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.792313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.792344 (+ 31us) server_negotiation.cc:407] Connection header received
0808 21:01:40.792401 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.792402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.792409 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.792447 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.792639 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.793076 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.793659 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.793842 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.793889 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.795365 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.795366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.795366 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.795372 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.796706 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.796993 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.796994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.796994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.797039 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.797184 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.797184 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.797184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.797263 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.797317 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.797407 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.797505 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":16}
I20260808 21:01:40.798851 25724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Bootstrap starting.
I20260808 21:01:40.799645 25724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:40.799882 25724 log.cc:824] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:40.800637 25724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: No bootstrap required, opened a new log
I20260808 21:01:40.802006 25724 raft_consensus.cc:348] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } }
I20260808 21:01:40.802121 25724 raft_consensus.cc:374] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:40.802143 25724 raft_consensus.cc:729] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 235f4379fe2e4e8f98b534bfb927fe30, State: Initialized, Role: FOLLOWER
I20260808 21:01:40.802264 25724 consensus_queue.cc:260] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } }
I20260808 21:01:40.802529 25724 sys_catalog.cc:564] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:40.802528 25734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } } }
I20260808 21:01:40.802667 25734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 21:01:40.804140 25753 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:01:40.804248 25753 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:01:40.806468 25628 master_runner.cc:428] Detected that this master 235f4379fe2e4e8f98b534bfb927fe30 is joining an existing cluster
I20260808 21:01:40.806522 25628 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.146.252:33449
I20260808 21:01:40.814061 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.807571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58174 (local address 127.14.146.253:39823)
0808 21:01:40.807614 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.807615 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.808024 (+ 409us) server_negotiation.cc:407] Connection header received
0808 21:01:40.808155 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.808156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.808167 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.808206 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.808628 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.809325 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.810043 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.810344 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.810412 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.811323 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.811325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.811325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.811333 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.812911 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.813266 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.813267 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.813267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.813327 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.813532 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.813533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.813533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.813648 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.813728 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.813897 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.813969 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:40.814472 25762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.807831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.0.0.1:58174)
0808 21:01:40.807966 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.807976 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.808048 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.808273 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.808274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.808472 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.808544 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.808546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.809410 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.809411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.809959 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.809960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.810433 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.810434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.810498 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.810927 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.810931 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.811234 (+ 303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.812995 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.812996 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.812997 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.813172 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.813404 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.813404 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.813405 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.813469 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.813727 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.813728 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.813785 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.813869 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.813970 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260808 21:01:40.818482 25732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.808047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41920 (local address 127.14.146.252:33449)
0808 21:01:40.808144 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.808146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.812251 (+ 4105us) server_negotiation.cc:407] Connection header received
0808 21:01:40.812319 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.812321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.812330 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.812392 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.812745 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.813457 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.814479 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.814757 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.814824 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.815780 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.815781 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.815782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.815787 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.817174 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.817602 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.817603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.817603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.817660 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.817914 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.817915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.817915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.818048 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.818114 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.818279 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.818404 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":80}
I20260808 21:01:40.818485 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.808163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.0.0.1:41920)
0808 21:01:40.812171 (+ 4008us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.812181 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.812263 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.812397 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.812397 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.812585 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.812661 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.812663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.813547 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.813547 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.814387 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.814390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.814890 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.814891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.814957 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.815292 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.815297 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.815696 (+ 399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.817251 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.817252 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.817252 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.817465 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.817735 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.817736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.817736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.817800 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.818122 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.818123 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.818167 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.818252 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.818354 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3991,"thread_start_us":87,"threads_started":1}
I20260808 21:01:40.828090 25761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.807547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38248)
0808 21:01:40.807698 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.807710 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.807762 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.808007 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.808008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.808262 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.808336 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.808344 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.809268 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.809269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.810148 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.810150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.810626 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.810627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.810696 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.824664 (+ 13968us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.824670 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.825028 (+ 358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.826691 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.826692 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.826693 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.826987 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.827259 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.827260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.827260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.827330 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.827636 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.827637 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.827703 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.827791 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.827927 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260808 21:01:40.828088 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.807786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38248 (local address 127.14.146.254:40719)
0808 21:01:40.807833 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.807835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.807844 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:40.807869 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.807870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.807890 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.807956 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.808437 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.809166 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.810295 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.810548 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.810623 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.825166 (+ 14543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.825168 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.825168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.825177 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.826570 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.827107 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.827108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.827108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.827181 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.827412 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.827413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.827414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.827557 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.827635 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.827837 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.827927 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222899, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.254@KRBTEST.COM for oryx/127.14.146.252@KRBTEST.COM
I20260808 21:01:40.837582 25732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.830281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41932 (local address 127.14.146.252:33449)
0808 21:01:40.830337 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.830339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.830347 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:40.830381 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.830382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.830392 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.830459 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.830728 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.831480 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.832484 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.832811 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.832878 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.835176 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.835178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.835178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.835184 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.836558 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.836933 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.836934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.836934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.836983 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.837171 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.837172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.837172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.837268 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.837319 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.837467 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.837522 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 21:01:40.837658 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.830196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.0.0.1:41932)
0808 21:01:40.830250 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.830262 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.830306 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.830468 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.830469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.830615 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.830660 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.830661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.831568 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.831569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.832376 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.832380 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.832937 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.832938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.833043 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.833532 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.833538 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.835094 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.836635 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.836636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.836636 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.836854 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.837043 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.837044 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.837044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.837111 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.837329 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.837330 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.837376 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.837453 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.837552 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 21:01:40.838291 24630 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.146.252:33449: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30"
member_type: NON_VOTER
last_known_addr {
host: "127.14.146.252"
port: 33449
}
attrs {
promote: true
}
}
dest_uuid: "aa156e781c1947b88022c59341a60bd8"
cas_config_opid_index: 5
I20260808 21:01:40.838563 24630 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } }
I20260808 21:01:40.838946 25487 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.839224 25682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:40.840042 25487 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.146.252:33449
I20260808 21:01:40.840144 25487 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.840204 25487 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:40.840245 25682 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Refusing update from remote peer aa156e781c1947b88022c59341a60bd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 21:01:40.840519 25489 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:40.840792 25628 master.cc:537] Master@127.14.146.252:33449 shutting down...
W20260808 21:01:40.842142 24606 consensus_peers.cc:487] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 -> Peer 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252:33449): Couldn't send request to peer 235f4379fe2e4e8f98b534bfb927fe30. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 21:01:40.843760 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.839051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.0.0.1:58190)
0808 21:01:40.839354 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.839364 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.839411 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.839619 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.839620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.839622 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:40.839656 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.839657 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.840552 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.840553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.842623 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.842627 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.843521 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.843522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.843584 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.843607 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.843655 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.843691 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289}
I20260808 21:01:40.843998 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.839159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58190 (local address 127.14.146.253:39823)
0808 21:01:40.839296 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.839299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.839462 (+ 163us) server_negotiation.cc:407] Connection header received
0808 21:01:40.839488 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.839489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.839512 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.839566 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:40.839734 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.840489 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.842727 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.843345 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.843414 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.843487 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.843895 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.843934 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 21:01:40.844239 25563 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 LEARNER]: Refusing update from remote peer aa156e781c1947b88022c59341a60bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 21:01:40.844529 25489 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 21:01:40.844939 25628 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:40.845039 25628 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:40.845094 25628 tablet_replica.cc:330] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: stopping tablet replica
I20260808 21:01:40.845105 25563 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.846204 25765 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.846307 25765 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: This master's current role is: LEARNER
I20260808 21:01:40.846418 25609 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa156e781c1947b88022c59341a60bd8. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: NON_VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: true } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.846546 25609 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: This master's current role is: LEARNER
W20260808 21:01:40.846740 24553 connection.cc:535] client connection to 127.14.146.252:33449 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 21:01:40.854254 25487 raft_consensus.cc:1050] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: attempting to promote NON_VOTER c7c34cf35a614be3899aefa168b2f13b to VOTER
I20260808 21:01:40.854460 25487 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } }
I20260808 21:01:40.854967 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.854863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.0.0.1:41942)
0808 21:01:40.854893 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.854940 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
I20260808 21:01:40.855062 25563 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 LEARNER]: Refusing update from remote peer aa156e781c1947b88022c59341a60bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 21:01:40.855309 25766 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 21:01:40.855393 25486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.855309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.0.0.1:41958)
0808 21:01:40.855342 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.855370 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33449: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 21:01:40.855516 24606 consensus_peers.cc:487] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 -> Peer 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252:33449): Couldn't send request to peer 235f4379fe2e4e8f98b534bfb927fe30. Status: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 21:01:40.855902 25487 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c7c34cf35a614be3899aefa168b2f13b (127.14.146.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.856104 25563 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c7c34cf35a614be3899aefa168b2f13b (127.14.146.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.856853 25487 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.856946 25487 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:40.856969 25609 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.857003 25487 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.857048 25609 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:01:40.857051 25487 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:40.858342 25628 master.cc:552] Master@127.14.146.252:33449 shutdown complete.
I20260808 21:01:40.858390 25628 master_runner.cc:305] Clearing existing system tablet
I20260808 21:01:40.858517 25628 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:40.858565 25628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:40.859267 25628 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:40.859782 25769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.859934 25628 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:40.860001 25628 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.860026 25628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
uuid: "235f4379fe2e4e8f98b534bfb927fe30"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "bec33a4c921b8af38521c91af0e37702"
server_key_iv: "6f96051779613c5ad273abb03b651ab7"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.860785 25628 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:40.862051 25628 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 21:01:40.862121 25628 log.cc:1196] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 21:01:40.862339 25628 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Deleting consensus metadata
I20260808 21:01:40.862466 25628 master_runner.cc:315] Copying system tablet from 127.14.146.254:40719
I20260808 21:01:40.863054 25628 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: tablet copy: Beginning tablet copy session from remote peer at address 127.14.146.254:40719
I20260808 21:01:40.869518 25779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.863313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38264)
0808 21:01:40.863449 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:40.863460 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:40.863522 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:40.863657 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:40.863657 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:40.863870 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:40.863913 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.863915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.864955 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.864956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.865575 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:40.865578 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.866026 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.866027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:40.866070 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.866561 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:40.866565 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:40.866865 (+ 300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:40.868580 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.868581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.868581 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.868756 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.868952 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:40.868953 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:40.868953 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:40.869004 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:40.869264 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:40.869265 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:40.869301 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 21:01:40.869352 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 21:01:40.869431 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260808 21:01:40.869545 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.863377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38264 (local address 127.14.146.254:40719)
0808 21:01:40.863421 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.863423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.863522 (+ 99us) server_negotiation.cc:407] Connection header received
0808 21:01:40.863581 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.863581 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.863592 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.863647 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.863987 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.864882 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.865650 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.865954 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.866028 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.866948 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.866949 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.866950 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.866956 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.868505 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.868826 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.868827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.868827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.868888 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.869063 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.869064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.869065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.869202 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.869271 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.869388 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.869462 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 21:01:40.870118 24665 tablet_copy_service.cc:140] P aa156e781c1947b88022c59341a60bd8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 235f4379fe2e4e8f98b534bfb927fe30 ({username='oryx', principal='oryx/127.14.146.252@KRBTEST.COM'} at 127.0.0.1:38264)
I20260808 21:01:40.870193 24665 tablet_copy_service.cc:161] P aa156e781c1947b88022c59341a60bd8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 235f4379fe2e4e8f98b534bfb927fe30 at {username='oryx', principal='oryx/127.14.146.252@KRBTEST.COM'} at 127.0.0.1:38264: session id = 235f4379fe2e4e8f98b534bfb927fe30-00000000000000000000000000000000
I20260808 21:01:40.870610 24665 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 21:01:40.871133 25628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 21:01:40.872386 25628 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: tablet copy: Starting download of 0 data blocks...
I20260808 21:01:40.872534 25628 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: tablet copy: Starting download of 1 WAL segments...
I20260808 21:01:40.873402 25628 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 21:01:40.874325 24665 tablet_copy_service.cc:342] P aa156e781c1947b88022c59341a60bd8: Request end of tablet copy session 235f4379fe2e4e8f98b534bfb927fe30-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.146.252@KRBTEST.COM'} at 127.0.0.1:38264
I20260808 21:01:40.874413 24665 tablet_copy_service.cc:433] P aa156e781c1947b88022c59341a60bd8: ending tablet copy session 235f4379fe2e4e8f98b534bfb927fe30-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 235f4379fe2e4e8f98b534bfb927fe30
I20260808 21:01:40.876755 25628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:40.877944 25781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.877944 25780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:40.880884 25783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:40.881023 25628 server_base.cc:1034] running on GCE node
I20260808 21:01:40.881119 25628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:40.881266 25628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:40.882398 25628 hybrid_clock.cc:648] HybridClock initialized: now 1786222900882391 us; error 26 us; skew 500 ppm
Aug 08 21:01:40 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222900, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:40.883917 25628 init.cc:377] Logged in from keytab as oryx/127.14.146.252@KRBTEST.COM (short username oryx)
I20260808 21:01:40.884260 25628 webserver.cc:460] Webserver started at http://127.14.146.252:41863/ using document root <none> and password file <none>
I20260808 21:01:40.884387 25628 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:40.884428 25628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:40.885169 25628 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:40.885738 25794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:40.885927 25628 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:40.885986 25628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
uuid: "235f4379fe2e4e8f98b534bfb927fe30"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "bec33a4c921b8af38521c91af0e37702"
server_key_iv: "6f96051779613c5ad273abb03b651ab7"
server_key_version: "encryptionkey@0"
I20260808 21:01:40.886047 25628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:40.895506 25628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:40.897182 25628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:40.900463 25628 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.252:33449
I20260808 21:01:40.900486 25874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.252:33449 every 8 connection(s)
I20260808 21:01:40.900811 25628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
I20260808 21:01:40.901578 25875 sys_catalog.cc:263] Verifying existing consensus state
I20260808 21:01:40.902029 25875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Bootstrap starting.
I20260808 21:01:40.904621 25875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:01:40.904857 25875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Bootstrap complete.
I20260808 21:01:40.905064 25875 raft_consensus.cc:348] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } }
I20260808 21:01:40.905134 25875 raft_consensus.cc:729] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 235f4379fe2e4e8f98b534bfb927fe30, State: Initialized, Role: LEARNER
I20260808 21:01:40.905162 25875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } }
I20260808 21:01:40.905356 25875 sys_catalog.cc:564] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:40.906823 25878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:40.906908 25878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: This master's current role is: LEARNER
I20260808 21:01:40.907076 25893 catalog_manager.cc:1259] Loaded cluster ID: 1df742c27eb84037968c901cf683f006
I20260808 21:01:40.907123 25893 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: loading cluster ID for follower catalog manager: success
I20260808 21:01:40.907992 25893 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: acquiring CA information for follower catalog manager: success
I20260808 21:01:40.908303 25893 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:01:40.955502 25894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:40.947696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41964 (local address 127.14.146.252:33449)
0808 21:01:40.947852 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:40.947853 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:40.947860 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:01:40.947885 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:40.947885 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:40.947894 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:40.947966 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:40.948652 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.949418 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.950348 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:40.950640 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:40.950732 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:40.952394 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:40.952395 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:40.952396 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:40.952403 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:40.954227 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.954563 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.954564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.954565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.954627 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:40.954859 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:40.954859 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:40.954860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:40.954994 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:40.955146 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:40.955307 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 21:01:40.955397 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":82,"threads_started":1}
I20260808 21:01:40.956113 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 24741
I20260808 21:01:40.971537 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:34723
--local_ip_for_outbound_sockets=127.14.146.193
--tserver_master_addrs=127.14.146.254:40719
--webserver_port=38933
--webserver_interface=127.14.146.193
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab
--principal=oryx/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823,127.14.146.252:33449 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:41.056108 25895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:41.056358 25895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:41.056401 25895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:41.057598 25895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:41.057665 25895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:41.057713 25895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:41.059286 25895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab
--principal=oryx/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:34723
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=38933
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823,127.14.146.252:33449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:41.059564 25895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:41.059803 25895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:41.065101 25906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:41.065076 25911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:41.065258 25895 server_base.cc:1034] running on GCE node
W20260808 21:01:41.065176 25905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:41.065769 25895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:41.066038 25895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:41.067183 25895 hybrid_clock.cc:648] HybridClock initialized: now 1786222901067167 us; error 28 us; skew 500 ppm
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:41.069886 25895 init.cc:377] Logged in from keytab as oryx/127.14.146.193@KRBTEST.COM (short username oryx)
I20260808 21:01:41.070290 25895 webserver.cc:460] Webserver started at http://127.14.146.193:38933/ using document root <none> and password file <none>
I20260808 21:01:41.070483 25895 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:41.070538 25895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:41.071846 25895 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:41.072499 25921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.072677 25895 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:41.072781 25895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c"
format_stamp: "Formatted at 2026-08-08 21:01:39 on dist-test-slave-t3q3"
server_key: "ece434692bd242b7719b2b7c068b12f3"
server_key_iv: "c6ea64a117f6dbd52422d0d568c20a55"
server_key_version: "encryptionkey@0"
I20260808 21:01:41.073140 25895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:41.095984 25895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:41.097999 25895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:41.098148 25895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:41.098397 25895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:41.098728 25895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:41.098785 25895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.098829 25895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:41.098856 25895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.104589 25895 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:34723
I20260808 21:01:41.104633 26084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:34723 every 8 connection(s)
I20260808 21:01:41.105016 25895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:41.107085 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 25895
I20260808 21:01:41.107275 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 24949
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.253@KRBTEST.COM
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.252@KRBTEST.COM
I20260808 21:01:41.130909 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.105787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:57901 (local address 127.14.146.253:39823)
0808 21:01:41.105863 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.105866 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.106090 (+ 224us) server_negotiation.cc:407] Connection header received
0808 21:01:41.119165 (+ 13075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.119167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.119183 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.119226 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.120427 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.121207 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.122819 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.123121 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.123163 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.127163 (+ 4000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.127164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.127165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.127173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.129149 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.129660 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.129662 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.129663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.129737 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.130075 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.130076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.130077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.130240 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.130300 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.130699 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.130797 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 21:01:41.131533 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.105770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.14.146.193:57901)
0808 21:01:41.105966 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.106011 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.119006 (+ 12995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.119434 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.119439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.119969 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:41.120305 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.120311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.121361 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.121362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.122707 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.122710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.123265 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.123265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.123432 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.124283 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:41.124288 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:41.127052 (+ 2764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:41.129221 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.129230 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.129232 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.129561 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.129818 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.129819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.129819 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.129966 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.130339 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:41.130345 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:41.130516 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.131034 (+ 518us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.131265 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":46,"thread_start_us":113,"threads_started":1}
I20260808 21:01:41.132193 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.106212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.14.146.193:54589)
0808 21:01:41.106897 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.106931 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.123246 (+ 16315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.123548 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.123550 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.123810 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:41.123897 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.123900 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.124919 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.124920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.125751 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.125754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.126426 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.126427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.126496 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.126943 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:41.126948 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:41.128749 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:41.130788 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.130789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.130789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.131130 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.131379 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.131379 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.131380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.131436 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.131852 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:41.131853 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:41.131895 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.131961 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.132091 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":87,"threads_started":1}
I20260808 21:01:41.132203 25894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.106113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:54589 (local address 127.14.146.252:33449)
0808 21:01:41.106164 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.106166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.106977 (+ 811us) server_negotiation.cc:407] Connection header received
0808 21:01:41.123397 (+ 16420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.123399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.123421 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.123460 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.124012 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.124819 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.125877 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.126333 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.126427 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.128860 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.128862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.128862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.128871 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.130702 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.131236 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.131238 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.131238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.131300 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.131503 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.131504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.131504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.131643 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.131691 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.131989 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.132112 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:01:41.132508 26088 heartbeater.cc:347] Connected to a master server at 127.14.146.253:39823
I20260808 21:01:41.132608 26088 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.132845 26088 heartbeater.cc:511] Master 127.14.146.253:39823 requested a full tablet report, sending...
I20260808 21:01:41.132963 26085 heartbeater.cc:347] Connected to a master server at 127.14.146.252:33449
I20260808 21:01:41.133035 26085 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.133116 26085 heartbeater.cc:511] Master 127.14.146.252:33449 requested a full tablet report, sending...
I20260808 21:01:41.133293 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.106090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:59981 (local address 127.14.146.254:40719)
0808 21:01:41.106166 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.106168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.106416 (+ 248us) server_negotiation.cc:407] Connection header received
0808 21:01:41.119165 (+ 12749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.119166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.119183 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.119218 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.120427 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.121209 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.122819 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.123120 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.123163 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.127081 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.127082 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.127083 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.127092 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.130691 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.131437 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.131439 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.131439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.131516 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.131892 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.131893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.131894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.132458 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.132526 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.133025 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.133133 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 21:01:41.133391 25551 ts_manager.cc:194] Registered new tserver with Master: d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723)
I20260808 21:01:41.133430 25816 ts_manager.cc:194] Registered new tserver with Master: d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723)
I20260808 21:01:41.134402 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.105786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:59981)
0808 21:01:41.106335 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.106345 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.119006 (+ 12661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.119434 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.119439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.119969 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:41.120305 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.120311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.121355 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.121357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.122707 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.122718 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.123261 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.123261 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.123432 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.124174 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:41.124186 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:41.126936 (+ 2750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:41.130805 (+ 3869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.130806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.130807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.131322 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.131604 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.131605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.131606 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.131679 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.132769 (+ 1090us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:41.132770 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:41.132829 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.133422 (+ 593us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.133556 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":70,"thread_start_us":106,"threads_started":1}
I20260808 21:01:41.138986 26087 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40719
I20260808 21:01:41.139068 26087 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.139158 26087 heartbeater.cc:511] Master 127.14.146.254:40719 requested a full tablet report, sending...
I20260808 21:01:41.139482 24630 ts_manager.cc:194] Re-registered known tserver with Master: d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723)
I20260808 21:01:41.140039 24630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:59981
I20260808 21:01:41.142520 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:35485
--local_ip_for_outbound_sockets=127.14.146.194
--tserver_master_addrs=127.14.146.254:40719
--webserver_port=34989
--webserver_interface=127.14.146.194
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab
--principal=oryx/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823,127.14.146.252:33449 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:41.226635 26093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:41.226884 26093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:41.226925 26093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:41.228144 26093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:41.228202 26093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:41.228247 26093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:41.229786 26093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab
--principal=oryx/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:35485
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=34989
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823,127.14.146.252:33449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:41.230031 26093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:41.230257 26093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:41.235527 26104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:41.235533 26106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:41.235541 26102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:41.235594 26093 server_base.cc:1034] running on GCE node
I20260808 21:01:41.235957 26093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:41.236241 26093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:41.237386 26093 hybrid_clock.cc:648] HybridClock initialized: now 1786222901237376 us; error 28 us; skew 500 ppm
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:41.240144 26093 init.cc:377] Logged in from keytab as oryx/127.14.146.194@KRBTEST.COM (short username oryx)
I20260808 21:01:41.240598 26093 webserver.cc:460] Webserver started at http://127.14.146.194:34989/ using document root <none> and password file <none>
I20260808 21:01:41.240784 26093 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:41.240837 26093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:41.242201 26093 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:41.242833 26115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.243041 26093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:41.243136 26093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "eb9ebcfd392c443c8fb57360332ceef5"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "a7344438c64db8c78f823afd4d91bb14"
server_key_iv: "95f7e6603e3b48f389505e30f3670838"
server_key_version: "encryptionkey@0"
I20260808 21:01:41.243480 26093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:41.257301 26093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:41.259615 26093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:41.259760 26093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:41.260018 26093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:41.260385 26093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:41.260442 26093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.260483 26093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:41.260510 26093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.266615 26093 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:35485
I20260808 21:01:41.266688 26293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:35485 every 8 connection(s)
I20260808 21:01:41.266999 26093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:41.268198 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 26093
I20260808 21:01:41.268394 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 25142
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.252@KRBTEST.COM
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:41.293905 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.268138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:36759 (local address 127.14.146.254:40719)
0808 21:01:41.268183 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.268185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.268194 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:41.282648 (+ 14454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.282650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.282666 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.282710 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.283969 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.284789 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.286475 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.286779 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.286817 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.290304 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.290305 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.290306 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.290315 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.292514 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.292915 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.292915 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.292916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.292968 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.293194 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.293195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.293196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.293325 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.293368 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.293716 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.293800 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:01:41.293905 25894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.267713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:35421 (local address 127.14.146.252:33449)
0808 21:01:41.267764 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.267767 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.267962 (+ 195us) server_negotiation.cc:407] Connection header received
0808 21:01:41.282648 (+ 14686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.282650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.282666 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.282701 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.283968 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.284786 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.286443 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.286744 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.286788 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.290304 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.290305 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.290306 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.290315 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.292209 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.292720 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.292722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.292722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.292779 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.293088 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.293089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.293089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.293250 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.293295 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.293707 (+ 412us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.293801 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:01:41.294559 26304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.267986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:36759)
0808 21:01:41.268129 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.268138 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.282471 (+ 14333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.282939 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.282942 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.283503 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:41.283837 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.283844 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.284943 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.284944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.286331 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.286335 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.286906 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.286908 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.287076 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.287883 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:41.287888 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:41.290182 (+ 2294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:41.292607 (+ 2425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.292607 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.292608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.292827 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.293062 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.293063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.293063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.293121 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.293412 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:41.293412 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:41.293526 (+ 114us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.294047 (+ 521us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.294341 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":240,"thread_start_us":61,"threads_started":1}
I20260808 21:01:41.294559 26301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.267687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.14.146.194:35421)
0808 21:01:41.267842 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.267881 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.282467 (+ 14586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.282937 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.282942 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.283503 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:41.283837 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.283844 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.284943 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.284944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.286331 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.286335 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.286916 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.286916 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.287076 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.287785 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:41.287796 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:41.290182 (+ 2386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:41.292307 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.292316 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.292318 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.292632 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.292853 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.292853 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.292854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.293005 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.293346 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:41.293353 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:41.293526 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.294047 (+ 521us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.294289 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":77,"thread_start_us":104,"threads_started":1}
I20260808 21:01:41.295023 26296 heartbeater.cc:347] Connected to a master server at 127.14.146.252:33449
I20260808 21:01:41.295035 26297 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40719
I20260808 21:01:41.295143 26296 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.295142 26297 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.295377 26296 heartbeater.cc:511] Master 127.14.146.252:33449 requested a full tablet report, sending...
I20260808 21:01:41.295377 26297 heartbeater.cc:511] Master 127.14.146.254:40719 requested a full tablet report, sending...
I20260808 21:01:41.295782 24630 ts_manager.cc:194] Re-registered known tserver with Master: eb9ebcfd392c443c8fb57360332ceef5 (127.14.146.194:35485)
I20260808 21:01:41.295843 25816 ts_manager.cc:194] Registered new tserver with Master: eb9ebcfd392c443c8fb57360332ceef5 (127.14.146.194:35485)
I20260808 21:01:41.296310 24630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:36759
I20260808 21:01:41.309872 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.267946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:56397 (local address 127.14.146.253:39823)
0808 21:01:41.267992 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.267994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.268003 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:41.306113 (+ 38110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.306115 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.306131 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.306266 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:41.306644 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.307447 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.309095 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.309457 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.309543 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.309553 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.309757 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.309792 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:01:41.309891 26303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.267686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.14.146.194:56397)
0808 21:01:41.267856 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.267882 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.305983 (+ 38101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.306424 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.306427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.306431 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:41.306527 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.306531 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.307546 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.307547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.308972 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.308975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.309553 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.309554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.309640 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.309658 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.309748 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.309792 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260808 21:01:41.310217 26298 heartbeater.cc:347] Connected to a master server at 127.14.146.253:39823
I20260808 21:01:41.310299 26298 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.310389 26298 heartbeater.cc:511] Master 127.14.146.253:39823 requested a full tablet report, sending...
I20260808 21:01:41.310695 25551 ts_manager.cc:194] Registered new tserver with Master: eb9ebcfd392c443c8fb57360332ceef5 (127.14.146.194:35485)
I20260808 21:01:41.313529 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:37367
--local_ip_for_outbound_sockets=127.14.146.195
--tserver_master_addrs=127.14.146.254:40719
--webserver_port=38437
--webserver_interface=127.14.146.195
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab
--principal=oryx/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:36551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823,127.14.146.252:33449 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:41.399431 26305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:41.399682 26305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:41.399722 26305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:41.401206 26305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:41.401392 26305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:41.401443 26305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:41.402998 26305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:36551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab
--principal=oryx/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:37367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=38437
--tserver_master_addrs=127.14.146.254:40719,127.14.146.253:39823,127.14.146.252:33449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:41.403271 26305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:41.403512 26305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:41.409065 26315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:41.409080 26312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:41.409302 26305 server_base.cc:1034] running on GCE node
W20260808 21:01:41.409071 26319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:41.409580 26305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:41.409864 26305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:41.411021 26305 hybrid_clock.cc:648] HybridClock initialized: now 1786222901411012 us; error 33 us; skew 500 ppm
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:41.413754 26305 init.cc:377] Logged in from keytab as oryx/127.14.146.195@KRBTEST.COM (short username oryx)
I20260808 21:01:41.414188 26305 webserver.cc:460] Webserver started at http://127.14.146.195:38437/ using document root <none> and password file <none>
I20260808 21:01:41.414419 26305 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:41.414496 26305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:41.415843 26305 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:41.416499 26329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.416685 26305 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.416781 26305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "fe20b63df900425dba5c9d915078d26c"
format_stamp: "Formatted at 2026-08-08 21:01:40 on dist-test-slave-t3q3"
server_key: "48f99269a05d85bef78b847f55c10631"
server_key_iv: "4adfa014028f9621bf20aaecb2958dc9"
server_key_version: "encryptionkey@0"
I20260808 21:01:41.417114 26305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:41.434983 26305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:41.437583 26305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:41.437733 26305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:41.438019 26305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:41.438360 26305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:41.438402 26305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.438446 26305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:41.438473 26305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:41.444579 26305 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:37367
I20260808 21:01:41.444660 26498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:37367 every 8 connection(s)
I20260808 21:01:41.445035 26305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:41.449119 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 26305
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.253@KRBTEST.COM
Aug 08 21:01:41 dist-test-slave-t3q3 krb5kdc[24555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222901, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.252@KRBTEST.COM
I20260808 21:01:41.458498 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.445924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:42947 (local address 127.14.146.253:39823)
0808 21:01:41.446086 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.446089 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.446473 (+ 384us) server_negotiation.cc:407] Connection header received
0808 21:01:41.447066 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.447067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.447080 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.447136 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.447992 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.448788 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450384 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.450690 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450733 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.454680 (+ 3947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.454682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.454682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.454691 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.456441 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.456939 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.456941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.456941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.457004 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.457327 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.457328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.457328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.457458 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.457519 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.458313 (+ 794us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.458398 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260808 21:01:41.459108 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.445836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.14.146.195:42947)
0808 21:01:41.446417 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.446427 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.446863 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.447656 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.447657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.447812 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:41.447873 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.447879 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.448894 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.448895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.450277 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.450280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.450833 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450833 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.450996 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.452243 (+ 1247us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:41.452248 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:41.454551 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:41.456530 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.456538 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.456540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.456853 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.457072 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.457073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.457073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.457254 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.457547 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:41.457554 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:41.457715 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.457825 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.458010 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":304,"thread_start_us":58,"threads_started":1}
I20260808 21:01:41.459602 26501 heartbeater.cc:347] Connected to a master server at 127.14.146.253:39823
I20260808 21:01:41.459709 26501 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.459915 26501 heartbeater.cc:511] Master 127.14.146.253:39823 requested a full tablet report, sending...
I20260808 21:01:41.460291 24699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.446015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:50189 (local address 127.14.146.254:40719)
0808 21:01:41.446092 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.446094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.446311 (+ 217us) server_negotiation.cc:407] Connection header received
0808 21:01:41.446979 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.446982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.446996 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.447055 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.447993 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.448812 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450383 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.450690 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450741 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.455473 (+ 4732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.455475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.455475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.455484 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.457923 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.458999 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.459000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.459001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.459069 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.459649 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.459650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.459651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.459802 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.459851 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.460122 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.460196 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 21:01:41.460433 25551 ts_manager.cc:194] Registered new tserver with Master: fe20b63df900425dba5c9d915078d26c (127.14.146.195:37367)
I20260808 21:01:41.460510 26506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.445836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:50189)
0808 21:01:41.446167 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.446211 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.446833 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.447208 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.447214 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.447703 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:41.447874 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.447879 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.448941 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.448941 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.450281 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.450282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.450831 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.450996 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.451820 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:41.451832 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:41.454979 (+ 3147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:41.458004 (+ 3025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.458004 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.458005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.458899 (+ 894us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.459151 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.459152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.459152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.459563 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.459939 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:41.459940 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:41.459986 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.460055 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.460187 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":26,"thread_start_us":93,"threads_started":1}
I20260808 21:01:41.460918 26500 heartbeater.cc:347] Connected to a master server at 127.14.146.254:40719
I20260808 21:01:41.460964 26500 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.461026 26500 heartbeater.cc:511] Master 127.14.146.254:40719 requested a full tablet report, sending...
I20260808 21:01:41.461025 25894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.445939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:40591 (local address 127.14.146.252:33449)
0808 21:01:41.446123 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.446125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.446311 (+ 186us) server_negotiation.cc:407] Connection header received
0808 21:01:41.447030 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.447032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.447047 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.447100 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.447981 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.448622 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450372 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.450679 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450732 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.455435 (+ 4703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.455437 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.455437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.455445 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.457423 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.457829 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.457831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.457831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.457890 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.458234 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.458235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.458235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.458426 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.458476 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.460829 (+ 2353us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.460923 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260808 21:01:41.461264 24630 ts_manager.cc:194] Re-registered known tserver with Master: fe20b63df900425dba5c9d915078d26c (127.14.146.195:37367)
I20260808 21:01:41.461347 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.445840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.14.146.195:40591)
0808 21:01:41.446167 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.446228 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.446833 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.447225 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.447249 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.447668 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:41.447873 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.447878 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.448739 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.448740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.450265 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.450269 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.450836 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.450837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.450996 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.451895 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:41.451900 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:41.455345 (+ 3445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:41.457522 (+ 2177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.457523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.457523 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.457737 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.457966 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:41.457967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:41.457967 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:41.458128 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:41.458531 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:41.458532 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:41.458577 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.461143 (+ 2566us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.461248 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":68,"thread_start_us":76,"threads_started":1}
I20260808 21:01:41.461745 24630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:50189
I20260808 21:01:41.462131 26499 heartbeater.cc:347] Connected to a master server at 127.14.146.252:33449
I20260808 21:01:41.462178 26499 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:41.462261 26499 heartbeater.cc:511] Master 127.14.146.252:33449 requested a full tablet report, sending...
I20260808 21:01:41.462553 25816 ts_manager.cc:194] Registered new tserver with Master: fe20b63df900425dba5c9d915078d26c (127.14.146.195:37367)
I20260808 21:01:41.463124 26518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.450853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38272 (local address 127.14.146.254:40719)
0808 21:01:41.451416 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.451418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.451602 (+ 184us) server_negotiation.cc:407] Connection header received
0808 21:01:41.451628 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.451630 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.451643 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.451708 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.455767 (+ 4059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.456582 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.457579 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.457888 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.457945 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.459515 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.459516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.459516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.459524 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.461482 (+ 1958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.461903 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.461904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.461904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.461968 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.462169 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.462169 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.462170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.462540 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.462633 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.462926 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.463035 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":542,"thread_start_us":62,"threads_started":1}
I20260808 21:01:41.465215 25894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.458896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41986 (local address 127.14.146.252:33449)
0808 21:01:41.461087 (+ 2191us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.461093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.461645 (+ 552us) server_negotiation.cc:407] Connection header received
0808 21:01:41.461746 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.461747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.461771 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.461812 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:41.462004 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.462726 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.464096 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.464766 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.464816 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.464891 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.465121 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.465161 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2175,"thread_start_us":64,"threads_started":1}
I20260808 21:01:41.465256 26523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.458706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.0.0.1:41986)
0808 21:01:41.461579 (+ 2873us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.461591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.461673 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.461878 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.461879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.461882 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:41.461923 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.461925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.462830 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.462830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.463938 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.463942 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.464961 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.464962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.465035 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.465040 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.465102 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.465148 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2857,"thread_start_us":53,"threads_started":1}
I20260808 21:01:41.465518 25832 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 21:01:41.465762 26525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa156e781c1947b88022c59341a60bd8. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:41.465850 26525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: This master's current role is: LEARNER
I20260808 21:01:41.467036 26522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.451929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41980 (local address 127.14.146.252:33449)
0808 21:01:41.452779 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.452782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.452791 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:41.452818 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.452818 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.452832 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.452909 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.453838 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.454592 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.461653 (+ 7061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.461960 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.462021 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.463659 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.463660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.463661 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.463668 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.465989 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.466356 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.466357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.466357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.466409 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.466617 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.466618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.466618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.466708 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.466789 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.466921 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.466979 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":827,"thread_start_us":56,"threads_started":1}
I20260808 21:01:41.465121 24630 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:41.467502 24630 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:41.468158 25766 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: NON_VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: true } } }
I20260808 21:01:41.468271 25766 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:41.469697 26528 raft_consensus.cc:1050] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: attempting to promote NON_VOTER 235f4379fe2e4e8f98b534bfb927fe30 to VOTER
I20260808 21:01:41.469925 26528 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } }
I20260808 21:01:41.470405 25562 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Refusing update from remote peer aa156e781c1947b88022c59341a60bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 21:01:41.470595 26541 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 21:01:41.471207 25832 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 LEARNER]: Refusing update from remote peer aa156e781c1947b88022c59341a60bd8: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 21:01:41.471194 25766 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:41.471571 26541 consensus_queue.cc:1035] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 21:01:41.471732 26516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.450444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58192 (local address 127.14.146.253:39823)
0808 21:01:41.451296 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.451298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.451507 (+ 209us) server_negotiation.cc:407] Connection header received
0808 21:01:41.451530 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.451531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.451545 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.451615 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.452493 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.453236 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.454360 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.454671 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.454731 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.459611 (+ 4880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.459613 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.459613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.459621 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.468561 (+ 8940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.470404 (+ 1843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.470405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.470406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.470562 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.470830 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.470831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.470831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.470981 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.471502 (+ 521us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.471540 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.471625 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":826,"thread_start_us":58,"threads_started":1}
I20260808 21:01:41.472016 25832 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:41.472278 25766 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:41.472378 25766 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:41.472450 25766 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:41.472503 25766 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:41.472636 25562 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:41.473140 26525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:41.473229 26525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:01:41.473765 26545 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:41.473862 26545 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:01:41.474031 26541 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aa156e781c1947b88022c59341a60bd8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:41.474156 26541 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:41.479238 26523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.475113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:37367 (local address 127.0.0.1:58812)
0808 21:01:41.475612 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.475623 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.475664 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.475921 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.475921 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.475923 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:41.475954 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.475955 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.477295 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.477297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.478262 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.478265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.478997 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.478998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.479056 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.479060 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.479120 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.479162 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":36,"thread_start_us":75,"threads_started":1}
I20260808 21:01:41.479537 26546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.475063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34723 (local address 127.0.0.1:48166)
0808 21:01:41.475371 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.475382 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.475441 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.476436 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.476437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.476439 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:41.476483 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.476484 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.477342 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.477343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.478535 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.478538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.479343 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.479344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.479412 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.479416 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.479448 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.479480 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":100}
I20260808 21:01:41.479543 26553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.475402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58812 (local address 127.14.146.195:37367)
0808 21:01:41.475778 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.475782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.475791 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:41.475833 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.475835 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.475849 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.475913 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:41.476035 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.477202 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.478324 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.478917 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.478995 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.479032 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.479415 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.479464 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":75,"threads_started":1}
I20260808 21:01:41.479941 26550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.475168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48166 (local address 127.14.146.193:34723)
0808 21:01:41.476237 (+ 1069us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.476242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.476253 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:41.476291 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.476293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.476309 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.476436 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:41.476553 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.477223 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.478622 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.479237 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.479734 (+ 497us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.479780 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.479802 (+ 22us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.479865 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1023,"thread_start_us":89,"threads_started":1}
I20260808 21:01:41.480320 26397 tablet_service.cc:1467] Processing CreateTablet for tablet f7cc4acb64304c63a441007afe863c7f (DEFAULT_TABLE table=test-table [id=310d593fb608441a8e2cd843b9f1c5c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:41.480633 26549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.475152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:35485 (local address 127.0.0.1:44824)
0808 21:01:41.475979 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.476028 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.476138 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.476321 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.476322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.476324 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:41.476364 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.476366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.477334 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.477335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.479214 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.479217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.480407 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.480408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.480470 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.480474 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.480524 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.480564 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"mutex_wait_us":775,"thread_start_us":100,"threads_started":1}
I20260808 21:01:41.480540 25986 tablet_service.cc:1467] Processing CreateTablet for tablet f7cc4acb64304c63a441007afe863c7f (DEFAULT_TABLE table=test-table [id=310d593fb608441a8e2cd843b9f1c5c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:41.480705 26397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7cc4acb64304c63a441007afe863c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:41.480870 25986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7cc4acb64304c63a441007afe863c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:41.481159 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.475394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44824 (local address 127.14.146.194:35485)
0808 21:01:41.475612 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.475617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.476143 (+ 526us) server_negotiation.cc:407] Connection header received
0808 21:01:41.476204 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.476206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.476220 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.476307 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:41.476457 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.477269 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.479307 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.480301 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.480408 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.480455 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.480807 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.480851 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":80,"threads_started":1}
I20260808 21:01:41.481719 26199 tablet_service.cc:1467] Processing CreateTablet for tablet f7cc4acb64304c63a441007afe863c7f (DEFAULT_TABLE table=test-table [id=310d593fb608441a8e2cd843b9f1c5c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:41.482040 26199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7cc4acb64304c63a441007afe863c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:41.484292 26554 tablet_bootstrap.cc:492] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Bootstrap starting.
I20260808 21:01:41.484748 26556 tablet_bootstrap.cc:492] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Bootstrap starting.
I20260808 21:01:41.485117 26554 tablet_bootstrap.cc:654] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:41.485395 26556 tablet_bootstrap.cc:654] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:41.485481 26554 log.cc:824] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:41.485706 26556 log.cc:824] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:41.485855 26555 tablet_bootstrap.cc:492] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Bootstrap starting.
I20260808 21:01:41.486368 26554 tablet_bootstrap.cc:492] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: No bootstrap required, opened a new log
I20260808 21:01:41.486476 26554 ts_tablet_manager.cc:1397] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:01:41.486519 26555 tablet_bootstrap.cc:654] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:41.486554 26556 tablet_bootstrap.cc:492] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: No bootstrap required, opened a new log
I20260808 21:01:41.486624 26556 ts_tablet_manager.cc:1397] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:41.486860 26555 log.cc:824] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:41.487664 26555 tablet_bootstrap.cc:492] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: No bootstrap required, opened a new log
I20260808 21:01:41.487748 26555 ts_tablet_manager.cc:1397] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:41.488657 26556 raft_consensus.cc:348] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.488831 26556 raft_consensus.cc:374] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:41.488870 26556 raft_consensus.cc:729] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9ebcfd392c443c8fb57360332ceef5, State: Initialized, Role: FOLLOWER
I20260808 21:01:41.488991 26556 consensus_queue.cc:260] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.488848 26554 raft_consensus.cc:348] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.489100 26554 raft_consensus.cc:374] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:41.489143 26554 raft_consensus.cc:729] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c8b3857c2c47bcab2f0b01d27d2e0c, State: Initialized, Role: FOLLOWER
I20260808 21:01:41.489267 26556 ts_tablet_manager.cc:1428] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:01:41.489256 26554 consensus_queue.cc:260] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.489562 26297 heartbeater.cc:503] Master 127.14.146.254:40719 was elected leader, sending a full tablet report...
I20260808 21:01:41.489678 26554 ts_tablet_manager.cc:1428] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 21:01:41.489773 26087 heartbeater.cc:503] Master 127.14.146.254:40719 was elected leader, sending a full tablet report...
I20260808 21:01:41.491163 26555 raft_consensus.cc:348] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.491287 26555 raft_consensus.cc:374] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:41.491309 26555 raft_consensus.cc:729] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe20b63df900425dba5c9d915078d26c, State: Initialized, Role: FOLLOWER
I20260808 21:01:41.491412 26555 consensus_queue.cc:260] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.491629 26555 ts_tablet_manager.cc:1428] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 21:01:41.491703 26500 heartbeater.cc:503] Master 127.14.146.254:40719 was elected leader, sending a full tablet report...
W20260808 21:01:41.518066 26300 tablet.cc:2369] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:01:41.606112 26089 tablet.cc:2369] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:01:41.695909 26502 tablet.cc:2369] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:41.715167 26567 raft_consensus.cc:482] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:41.715307 26567 raft_consensus.cc:504] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.715731 26567 leader_election.cc:288] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723), eb9ebcfd392c443c8fb57360332ceef5 (127.14.146.194:35485)
I20260808 21:01:41.719844 26552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.716251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:48127 (local address 127.14.146.194:35485)
0808 21:01:41.716328 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.716330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.716338 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:41.716366 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.716367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.716377 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.716438 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:41.716567 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.717334 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.718864 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.719459 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.719544 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.719554 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.719733 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.719776 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 21:01:41.719870 26550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.716086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:37317 (local address 127.14.146.193:34723)
0808 21:01:41.716138 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.716140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.716153 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:01:41.716259 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.716260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.716288 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.716347 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:41.716553 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.717310 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.718864 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.719459 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.719544 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.719554 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.719747 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.719786 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 21:01:41.719877 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.715982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34723 (local address 127.14.146.195:37317)
0808 21:01:41.716051 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.716090 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.716162 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.716364 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.716365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.716366 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:41.716457 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.716460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.717409 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.717409 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.718749 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.718753 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.719552 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.719553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.719650 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.719653 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.719719 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.719762 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":81}
I20260808 21:01:41.719895 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.716135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:35485 (local address 127.14.146.195:48127)
0808 21:01:41.716183 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:41.716195 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:41.716238 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:41.716453 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:41.716453 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:41.716454 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:41.716496 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.716497 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.717409 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.717409 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.718749 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:41.718753 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.719552 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.719553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:41.719645 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.719649 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:41.719715 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 21:01:41.719762 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":79}
I20260808 21:01:41.720297 26013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7cc4acb64304c63a441007afe863c7f" candidate_uuid: "fe20b63df900425dba5c9d915078d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" is_pre_election: true
I20260808 21:01:41.720459 26013 raft_consensus.cc:2454] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe20b63df900425dba5c9d915078d26c in term 0.
I20260808 21:01:41.720589 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7cc4acb64304c63a441007afe863c7f" candidate_uuid: "fe20b63df900425dba5c9d915078d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9ebcfd392c443c8fb57360332ceef5" is_pre_election: true
I20260808 21:01:41.720717 26330 leader_election.cc:302] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1c8b3857c2c47bcab2f0b01d27d2e0c, fe20b63df900425dba5c9d915078d26c; no voters:
I20260808 21:01:41.720768 26228 raft_consensus.cc:2454] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe20b63df900425dba5c9d915078d26c in term 0.
I20260808 21:01:41.720865 26567 raft_consensus.cc:2781] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:41.720958 26567 raft_consensus.cc:482] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:41.720993 26567 raft_consensus.cc:3037] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:41.721732 26567 raft_consensus.cc:504] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.721877 26567 leader_election.cc:288] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [CANDIDATE]: Term 1 election: Requested vote from peers d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723), eb9ebcfd392c443c8fb57360332ceef5 (127.14.146.194:35485)
I20260808 21:01:41.722040 26013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7cc4acb64304c63a441007afe863c7f" candidate_uuid: "fe20b63df900425dba5c9d915078d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c"
I20260808 21:01:41.722048 26228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7cc4acb64304c63a441007afe863c7f" candidate_uuid: "fe20b63df900425dba5c9d915078d26c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb9ebcfd392c443c8fb57360332ceef5"
I20260808 21:01:41.722141 26013 raft_consensus.cc:3037] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:41.722174 26228 raft_consensus.cc:3037] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:41.722853 26013 raft_consensus.cc:2454] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe20b63df900425dba5c9d915078d26c in term 1.
I20260808 21:01:41.722899 26228 raft_consensus.cc:2454] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe20b63df900425dba5c9d915078d26c in term 1.
I20260808 21:01:41.723063 26330 leader_election.cc:302] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb9ebcfd392c443c8fb57360332ceef5, fe20b63df900425dba5c9d915078d26c; no voters:
I20260808 21:01:41.723186 26567 raft_consensus.cc:2781] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:41.723404 26567 raft_consensus.cc:686] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 1 LEADER]: Becoming Leader. State: Replica: fe20b63df900425dba5c9d915078d26c, State: Running, Role: LEADER
I20260808 21:01:41.723519 26567 consensus_queue.cc:237] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } }
I20260808 21:01:41.724400 24629 catalog_manager.cc:5495] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c reported cstate change: term changed from 0 to 1, leader changed from <none> to fe20b63df900425dba5c9d915078d26c (127.14.146.195). New cstate: current_term: 1 leader_uuid: "fe20b63df900425dba5c9d915078d26c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } health_report { overall_health: HEALTHY } } }
I20260808 21:01:41.759454 26553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.756818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58816 (local address 127.14.146.195:37367)
0808 21:01:41.756882 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.756884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.756893 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:41.756935 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.756936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.756956 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.757020 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:41.757140 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.757621 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.758395 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.758583 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.758635 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.759083 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:41.759191 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:41.759261 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.759323 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.759342 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:01:41.761588 26228 raft_consensus.cc:1261] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 1 FOLLOWER]: Refusing update from remote peer fe20b63df900425dba5c9d915078d26c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:41.761636 26013 raft_consensus.cc:1261] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 1 FOLLOWER]: Refusing update from remote peer fe20b63df900425dba5c9d915078d26c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:41.761994 26568 consensus_queue.cc:1035] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:41.762269 26567 consensus_queue.cc:1035] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:41.768572 24629 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:41.768716 24629 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:41.770610 24629 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aa156e781c1947b88022c59341a60bd8: Sending DeleteTablet for 3 replicas of tablet f7cc4acb64304c63a441007afe863c7f
I20260808 21:01:41.771027 26397 tablet_service.cc:1514] Processing DeleteTablet for tablet f7cc4acb64304c63a441007afe863c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:41 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:58812
I20260808 21:01:41.771085 25986 tablet_service.cc:1514] Processing DeleteTablet for tablet f7cc4acb64304c63a441007afe863c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:41 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:48166
I20260808 21:01:41.771298 26588 tablet_replica.cc:330] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: stopping tablet replica
I20260808 21:01:41.771446 26588 raft_consensus.cc:2229] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:41.771482 26199 tablet_service.cc:1514] Processing DeleteTablet for tablet f7cc4acb64304c63a441007afe863c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:41 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:44824
I20260808 21:01:41.771685 26588 raft_consensus.cc:2258] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:41.771881 26589 tablet_replica.cc:330] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: stopping tablet replica
I20260808 21:01:41.771988 26589 raft_consensus.cc:2229] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:41.772120 26589 raft_consensus.cc:2258] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:41.772176 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 24578
I20260808 21:01:41.772372 26587 tablet_replica.cc:330] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: stopping tablet replica
I20260808 21:01:41.772594 26588 ts_tablet_manager.cc:1905] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:41.773989 26588 ts_tablet_manager.cc:1918] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:41.774111 26588 log.cc:1196] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/f7cc4acb64304c63a441007afe863c7f
I20260808 21:01:41.774403 26588 ts_tablet_manager.cc:1939] T f7cc4acb64304c63a441007afe863c7f P d1c8b3857c2c47bcab2f0b01d27d2e0c: Deleting consensus metadata
I20260808 21:01:41.776661 26587 raft_consensus.cc:2229] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:41.776813 26587 raft_consensus.cc:2258] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:41.778257 26587 ts_tablet_manager.cc:1905] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:41.779949 26589 ts_tablet_manager.cc:1905] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:41.781829 26589 ts_tablet_manager.cc:1918] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:41.781917 26589 log.cc:1196] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/f7cc4acb64304c63a441007afe863c7f
I20260808 21:01:41.782188 26589 ts_tablet_manager.cc:1939] T f7cc4acb64304c63a441007afe863c7f P eb9ebcfd392c443c8fb57360332ceef5: Deleting consensus metadata
I20260808 21:01:41.783382 26587 ts_tablet_manager.cc:1918] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:41.783468 26587 log.cc:1196] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/f7cc4acb64304c63a441007afe863c7f
I20260808 21:01:41.783788 26587 ts_tablet_manager.cc:1939] T f7cc4acb64304c63a441007afe863c7f P fe20b63df900425dba5c9d915078d26c: Deleting consensus metadata
W20260808 21:01:41.786772 26331 connection.cc:535] server connection from 127.0.0.1:58812 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 21:01:41.786767 26120 connection.cc:535] server connection from 127.0.0.1:44824 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 21:01:41.787068 25926 connection.cc:535] server connection from 127.0.0.1:48166 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 21:01:41.797019 26522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.788838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41988 (local address 127.14.146.252:33449)
0808 21:01:41.788886 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.788888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.788969 (+ 81us) server_negotiation.cc:407] Connection header received
0808 21:01:41.789087 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.789088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.789104 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.789137 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.790043 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.790852 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.791572 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.791830 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.791896 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.793958 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.793959 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.793960 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.793967 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.795684 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.796176 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.796177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.796177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.796243 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.796434 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.796435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.796435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.796581 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.796691 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.796831 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.796911 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:01:41.797235 26516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:41.788674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58202 (local address 127.14.146.253:39823)
0808 21:01:41.788725 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:41.788727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:41.789015 (+ 288us) server_negotiation.cc:407] Connection header received
0808 21:01:41.789083 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:41.789084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:41.789100 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:41.789161 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:41.790962 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.791733 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.792570 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:41.792796 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:41.792884 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:41.794056 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:41.794057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:41.794057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:41.794064 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:41.795796 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.796247 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.796248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.796249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.796308 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:41.796517 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:41.796519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:41.796519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:41.796674 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:41.796771 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:41.797037 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 21:01:41.797130 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 21:01:42.767215 26604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:42.766949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:45411)
0808 21:01:42.767084 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:42.767168 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
W20260808 21:01:42.767462 26087 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:40719 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:42.768581 26606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:42.768324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:35537)
0808 21:01:42.768445 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:42.768528 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
W20260808 21:01:42.768867 26297 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:40719 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:42.768952 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:42.768719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:50751)
0808 21:01:42.768822 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:42.768890 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":61,"threads_started":1}
W20260808 21:01:42.769253 26500 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:40719 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:43.271838 26609 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa156e781c1947b88022c59341a60bd8)
I20260808 21:01:43.271848 26611 raft_consensus.cc:482] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa156e781c1947b88022c59341a60bd8)
I20260808 21:01:43.271994 26611 raft_consensus.cc:504] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } }
I20260808 21:01:43.271998 26609 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } }
I20260808 21:01:43.272318 26609 leader_election.cc:288] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719), 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252:33449)
I20260808 21:01:43.272564 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.272375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38770)
0808 21:01:43.272473 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.272517 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":45,"threads_started":1}
I20260808 21:01:43.272596 26611 leader_election.cc:288] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719), c7c34cf35a614be3899aefa168b2f13b (127.14.146.253:39823)
W20260808 21:01:43.272699 25798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:43.272778 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.272400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38786)
0808 21:01:43.272693 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.272737 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":47,"threads_started":1}
W20260808 21:01:43.272887 25530 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:43.273149 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.273018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38794)
0808 21:01:43.273089 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.273121 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 21:01:43.273283 25798 leader_election.cc:334] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719): Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:43.273319 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.273224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38808)
0808 21:01:43.273262 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.273292 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 21:01:43.273388 25530 leader_election.cc:334] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719): Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:43.275796 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.272745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42000 (local address 127.14.146.252:33449)
0808 21:01:43.272849 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:43.272850 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:43.273131 (+ 281us) server_negotiation.cc:407] Connection header received
0808 21:01:43.273199 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:43.273200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:43.273211 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:43.273279 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:43.273455 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:43.273979 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:43.274948 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:43.275412 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:43.275513 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:43.275523 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:43.275679 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 21:01:43.275722 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":53,"threads_started":1}
I20260808 21:01:43.275803 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.272495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33449 (local address 127.0.0.1:42000)
0808 21:01:43.273079 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.273089 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:43.273144 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:43.273340 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:43.273341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:43.273343 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:43.273394 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:43.273396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:43.274058 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:43.274059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:43.274862 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:43.274865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:43.275517 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:43.275518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:43.275584 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:43.275589 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:43.275670 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:01:43.275706 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":42,"threads_started":1}
I20260808 21:01:43.275902 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.272394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39823 (local address 127.0.0.1:58210)
0808 21:01:43.272586 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.272598 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:43.272804 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:43.273478 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:43.273479 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:43.273481 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:43.273528 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:43.273530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:43.274243 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:43.274244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:43.275000 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:43.275002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:43.275644 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:43.275645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:43.275704 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:43.275708 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:43.275767 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 21:01:43.275798 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":43,"threads_started":1}
I20260808 21:01:43.275900 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.272516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58210 (local address 127.14.146.253:39823)
0808 21:01:43.272685 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:43.272687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:43.272696 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:43.273237 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:43.273238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:43.273248 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:43.273301 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:43.273603 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:43.274164 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:43.275082 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:43.275431 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:43.275589 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:43.275598 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:43.275782 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 21:01:43.275819 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":58,"threads_started":1}
I20260808 21:01:43.276304 25562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "235f4379fe2e4e8f98b534bfb927fe30" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c7c34cf35a614be3899aefa168b2f13b" is_pre_election: true
I20260808 21:01:43.276302 25832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c7c34cf35a614be3899aefa168b2f13b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "235f4379fe2e4e8f98b534bfb927fe30" is_pre_election: true
I20260808 21:01:43.276396 25562 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 235f4379fe2e4e8f98b534bfb927fe30 in term 1.
I20260808 21:01:43.276419 25832 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c34cf35a614be3899aefa168b2f13b in term 1.
I20260808 21:01:43.276593 25528 leader_election.cc:302] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 235f4379fe2e4e8f98b534bfb927fe30, c7c34cf35a614be3899aefa168b2f13b; no voters: aa156e781c1947b88022c59341a60bd8
I20260808 21:01:43.276607 25799 leader_election.cc:302] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 235f4379fe2e4e8f98b534bfb927fe30, c7c34cf35a614be3899aefa168b2f13b; no voters: aa156e781c1947b88022c59341a60bd8
I20260808 21:01:43.276721 26611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 21:01:43.276772 26611 raft_consensus.cc:482] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa156e781c1947b88022c59341a60bd8)
I20260808 21:01:43.276793 26611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 1 FOLLOWER]: Advancing to term 2
I20260808 21:01:43.277489 26611 raft_consensus.cc:504] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } }
I20260808 21:01:43.277637 26611 leader_election.cc:288] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 2 election: Requested vote from peers aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719), c7c34cf35a614be3899aefa168b2f13b (127.14.146.253:39823)
I20260808 21:01:43.277712 26609 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 21:01:43.277752 26609 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa156e781c1947b88022c59341a60bd8)
I20260808 21:01:43.277781 26609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 1 FOLLOWER]: Advancing to term 2
I20260808 21:01:43.277799 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.277704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38812)
0808 21:01:43.277748 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.277772 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 21:01:43.277803 25562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "235f4379fe2e4e8f98b534bfb927fe30" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c7c34cf35a614be3899aefa168b2f13b"
I20260808 21:01:43.278091 26612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.277967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38828)
0808 21:01:43.278038 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.278072 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 21:01:43.278199 25798 leader_election.cc:334] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719): Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:43.278575 26609 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } }
I20260808 21:01:43.278700 25562 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 235f4379fe2e4e8f98b534bfb927fe30 in current term 2: Already voted for candidate c7c34cf35a614be3899aefa168b2f13b in this term.
I20260808 21:01:43.278736 26609 leader_election.cc:288] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [CANDIDATE]: Term 2 election: Requested vote from peers aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719), 235f4379fe2e4e8f98b534bfb927fe30 (127.14.146.252:33449)
I20260808 21:01:43.278885 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.278793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38830)
0808 21:01:43.278830 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.278863 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 21:01:43.278872 25832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c7c34cf35a614be3899aefa168b2f13b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "235f4379fe2e4e8f98b534bfb927fe30"
I20260808 21:01:43.278954 25832 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7c34cf35a614be3899aefa168b2f13b in current term 2: Already voted for candidate 235f4379fe2e4e8f98b534bfb927fe30 in this term.
I20260808 21:01:43.279145 25799 leader_election.cc:302] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 235f4379fe2e4e8f98b534bfb927fe30; no voters: aa156e781c1947b88022c59341a60bd8, c7c34cf35a614be3899aefa168b2f13b
I20260808 21:01:43.279210 26619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.279129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:38838)
0808 21:01:43.279163 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.279183 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 21:01:43.279232 26611 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260808 21:01:43.279265 25530 leader_election.cc:334] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719): Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:43.279300 25530 leader_election.cc:302] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c34cf35a614be3899aefa168b2f13b; no voters: 235f4379fe2e4e8f98b534bfb927fe30, aa156e781c1947b88022c59341a60bd8
I20260808 21:01:43.279358 26609 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 21:01:43.768203 26624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.767918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:52537)
0808 21:01:43.768105 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.768151 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":110,"threads_started":1}
I20260808 21:01:43.769405 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.769204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:46995)
0808 21:01:43.769331 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.769370 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260808 21:01:43.769757 26626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:43.769545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:51329)
0808 21:01:43.769656 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:43.769697 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":64,"threads_started":1}
I20260808 21:01:44.768981 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.768698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:44203)
0808 21:01:44.768872 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.768927 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260808 21:01:44.770090 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.769861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:41435)
0808 21:01:44.769991 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.770044 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":49,"threads_started":1}
I20260808 21:01:44.770583 26629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.770193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:40543)
0808 21:01:44.770473 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.770539 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":72,"threads_started":1}
I20260808 21:01:44.812785 26630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:44.812881 26630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } }
I20260808 21:01:44.813046 26630 leader_election.cc:288] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719), c7c34cf35a614be3899aefa168b2f13b (127.14.146.253:39823)
I20260808 21:01:44.813283 25562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "235f4379fe2e4e8f98b534bfb927fe30" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c7c34cf35a614be3899aefa168b2f13b" is_pre_election: true
I20260808 21:01:44.813383 25562 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 235f4379fe2e4e8f98b534bfb927fe30 in term 2.
I20260808 21:01:44.813367 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.813173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:39006)
0808 21:01:44.813297 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.813335 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":77,"threads_started":1}
I20260808 21:01:44.813547 25799 leader_election.cc:302] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 235f4379fe2e4e8f98b534bfb927fe30, c7c34cf35a614be3899aefa168b2f13b; no voters:
I20260808 21:01:44.813637 26630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 21:01:44.813681 26630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:44.813706 26630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 2 FOLLOWER]: Advancing to term 3
I20260808 21:01:44.813853 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.813752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:39018)
0808 21:01:44.813796 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.813820 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 21:01:44.813934 25798 leader_election.cc:334] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719): Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:44.814523 26630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } }
I20260808 21:01:44.814666 26630 leader_election.cc:288] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 3 election: Requested vote from peers aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719), c7c34cf35a614be3899aefa168b2f13b (127.14.146.253:39823)
I20260808 21:01:44.814848 25562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "235f4379fe2e4e8f98b534bfb927fe30" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c7c34cf35a614be3899aefa168b2f13b"
I20260808 21:01:44.814931 25562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 2 FOLLOWER]: Advancing to term 3
I20260808 21:01:44.814951 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.814828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:39032)
0808 21:01:44.814880 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.814908 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 21:01:44.815343 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.815264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:39044)
0808 21:01:44.815307 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.815329 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 21:01:44.815439 25798 leader_election.cc:334] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719): Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
I20260808 21:01:44.815760 25562 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 235f4379fe2e4e8f98b534bfb927fe30 in term 3.
I20260808 21:01:44.815928 25799 leader_election.cc:302] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 235f4379fe2e4e8f98b534bfb927fe30, c7c34cf35a614be3899aefa168b2f13b; no voters: aa156e781c1947b88022c59341a60bd8
I20260808 21:01:44.816079 26630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 21:01:44.816205 26630 raft_consensus.cc:686] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [term 3 LEADER]: Becoming Leader. State: Replica: 235f4379fe2e4e8f98b534bfb927fe30, State: Running, Role: LEADER
I20260808 21:01:44.816280 26630 consensus_queue.cc:237] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } }
I20260808 21:01:44.816646 26634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 235f4379fe2e4e8f98b534bfb927fe30. Latest consensus state: current_term: 3 leader_uuid: "235f4379fe2e4e8f98b534bfb927fe30" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:44.816756 26634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:44.816944 26636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:44.817432 26636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:44.817523 26636 catalog_manager.cc:1259] Loaded cluster ID: 1df742c27eb84037968c901cf683f006
I20260808 21:01:44.817559 26636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:44.817739 26636 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:44.817833 26636 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Loaded TSK: 0
I20260808 21:01:44.817981 26636 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:01:44.880338 25816 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41988:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:44.881959 25816 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:44.883090 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.882963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:39074)
0808 21:01:44.883031 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.883065 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 21:01:44.883106 25562 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [term 3 FOLLOWER]: Refusing update from remote peer 235f4379fe2e4e8f98b534bfb927fe30: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 21:01:44.883369 26634 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 21:01:44.883504 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.883395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.0.0.1:39076)
0808 21:01:44.883452 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.883483 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 21:01:44.883582 25798 consensus_peers.cc:487] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 -> Peer aa156e781c1947b88022c59341a60bd8 (127.14.146.254:40719): Couldn't send request to peer aa156e781c1947b88022c59341a60bd8. Status: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 21:01:44.884136 26639 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 235f4379fe2e4e8f98b534bfb927fe30. Latest consensus state: current_term: 3 leader_uuid: "235f4379fe2e4e8f98b534bfb927fe30" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:44.884253 26639 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:01:44.884622 26638 mvcc.cc:205] Tried to move back new op lower bound from 7316369018398666752 to 7316369018127978496. Current Snapshot: MvccSnapshot[applied={T|T < 7316369018398666752}]
I20260808 21:01:44.884748 26630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "235f4379fe2e4e8f98b534bfb927fe30" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:44.884843 26630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:44.884945 26640 mvcc.cc:205] Tried to move back new op lower bound from 7316369018398666752 to 7316369018127978496. Current Snapshot: MvccSnapshot[applied={T|T < 7316369018398666752}]
I20260808 21:01:44.885042 26639 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "235f4379fe2e4e8f98b534bfb927fe30" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "aa156e781c1947b88022c59341a60bd8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40719 } } peers { permanent_uuid: "c7c34cf35a614be3899aefa168b2f13b" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39823 } attrs { promote: false } } peers { permanent_uuid: "235f4379fe2e4e8f98b534bfb927fe30" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33449 } attrs { promote: false } } }
I20260808 21:01:44.885154 26639 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c34cf35a614be3899aefa168b2f13b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:01:44.890305 26653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.886855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58832 (local address 127.14.146.195:37367)
0808 21:01:44.887147 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:44.887149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:44.887157 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:44.887182 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:44.887182 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:44.887193 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:44.887252 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:44.887429 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.888243 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.889507 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.889950 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.890040 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.890049 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:44.890193 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 21:01:44.890238 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":78,"threads_started":1}
I20260808 21:01:44.890304 26651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.886678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:37367 (local address 127.0.0.1:58832)
0808 21:01:44.886984 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.886996 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:44.887051 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:44.887267 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:44.887268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:44.887270 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:44.887328 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.887330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.888336 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.888337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.889433 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.889436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.890036 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.890037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.890097 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.890102 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:44.890185 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 21:01:44.890232 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":110,"threads_started":1}
I20260808 21:01:44.890471 26649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.886755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44830 (local address 127.14.146.194:35485)
0808 21:01:44.886994 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:44.886996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:44.887006 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:44.887036 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:44.887038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:44.887049 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:44.887123 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:44.887466 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.888006 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.889439 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.890031 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.890101 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.890109 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:44.890344 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 21:01:44.890393 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":55,"threads_started":1}
I20260808 21:01:44.890527 26648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.886649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:35485 (local address 127.0.0.1:44830)
0808 21:01:44.886872 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.886884 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:44.886934 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:44.887304 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:44.887305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:44.887307 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:44.887359 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.887361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.888115 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.888117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.889352 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.889355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.890143 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.890144 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.890207 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.890212 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:44.890262 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 21:01:44.890312 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":32}
I20260808 21:01:44.890697 26654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.887037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48172 (local address 127.14.146.193:34723)
0808 21:01:44.887338 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:44.887340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:44.887348 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:44.887374 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:44.887375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:44.887387 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:44.887448 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:44.887591 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.888321 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.889613 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.890208 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.890274 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.890282 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:44.890564 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 21:01:44.890623 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":49,"threads_started":1}
I20260808 21:01:44.890645 26632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.886824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34723 (local address 127.0.0.1:48172)
0808 21:01:44.887148 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.887158 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:44.887209 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:44.887495 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:44.887496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:44.887498 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:44.887528 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.887529 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.888397 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.888398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.889538 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.889539 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.890312 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.890313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.890377 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.890380 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:44.890426 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 21:01:44.890464 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":37,"thread_start_us":117,"threads_started":1}
I20260808 21:01:44.890820 26199 tablet_service.cc:1467] Processing CreateTablet for tablet ad546a6f824048798efd824502c0a4da (DEFAULT_TABLE table=test-table [id=6818c42d509a4033afb5536f3f768d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:44.890966 26199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad546a6f824048798efd824502c0a4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:44.890961 25986 tablet_service.cc:1467] Processing CreateTablet for tablet ad546a6f824048798efd824502c0a4da (DEFAULT_TABLE table=test-table [id=6818c42d509a4033afb5536f3f768d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:44.891073 25986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad546a6f824048798efd824502c0a4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:44.892283 26397 tablet_service.cc:1467] Processing CreateTablet for tablet ad546a6f824048798efd824502c0a4da (DEFAULT_TABLE table=test-table [id=6818c42d509a4033afb5536f3f768d55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:44.892418 26397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad546a6f824048798efd824502c0a4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:44.892524 26655 tablet_bootstrap.cc:492] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: Bootstrap starting.
I20260808 21:01:44.892894 26655 tablet_bootstrap.cc:654] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:44.893193 26657 tablet_bootstrap.cc:492] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c: Bootstrap starting.
I20260808 21:01:44.893487 26655 tablet_bootstrap.cc:492] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: No bootstrap required, opened a new log
I20260808 21:01:44.893512 26657 tablet_bootstrap.cc:654] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:44.893536 26655 ts_tablet_manager.cc:1397] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:44.893656 26655 raft_consensus.cc:348] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.893754 26655 raft_consensus.cc:374] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:44.893775 26655 raft_consensus.cc:729] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb9ebcfd392c443c8fb57360332ceef5, State: Initialized, Role: FOLLOWER
I20260808 21:01:44.893849 26662 tablet_bootstrap.cc:492] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: Bootstrap starting.
I20260808 21:01:44.893837 26655 consensus_queue.cc:260] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.894032 26655 ts_tablet_manager.cc:1428] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:44.894403 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.894310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:47723)
0808 21:01:44.894345 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.894375 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 21:01:44.894631 26296 heartbeater.cc:503] Master 127.14.146.252:33449 was elected leader, sending a full tablet report...
I20260808 21:01:44.894717 26662 tablet_bootstrap.cc:654] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:44.895048 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.894623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:58241)
0808 21:01:44.894990 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.895021 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348}
I20260808 21:01:44.895439 26657 tablet_bootstrap.cc:492] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c: No bootstrap required, opened a new log
I20260808 21:01:44.895509 26657 ts_tablet_manager.cc:1397] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:44.895596 26662 tablet_bootstrap.cc:492] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: No bootstrap required, opened a new log
I20260808 21:01:44.895639 26662 ts_tablet_manager.cc:1397] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:44.895670 26657 raft_consensus.cc:348] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.895743 26657 raft_consensus.cc:374] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:44.895778 26657 raft_consensus.cc:729] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c8b3857c2c47bcab2f0b01d27d2e0c, State: Initialized, Role: FOLLOWER
I20260808 21:01:44.895740 26662 raft_consensus.cc:348] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.895817 26662 raft_consensus.cc:374] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:44.895821 26657 consensus_queue.cc:260] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.895867 26662 raft_consensus.cc:729] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe20b63df900425dba5c9d915078d26c, State: Initialized, Role: FOLLOWER
I20260808 21:01:44.895927 26662 consensus_queue.cc:260] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.896030 26657 ts_tablet_manager.cc:1428] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:44.896144 26662 ts_tablet_manager.cc:1428] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:44.896420 26629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.896288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:42869)
0808 21:01:44.896358 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.896389 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 21:01:44.896596 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.896312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:53241)
0808 21:01:44.896507 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.896565 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260808 21:01:44.896718 26629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.896626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:50079)
0808 21:01:44.896665 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.896689 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 21:01:44.896862 26499 heartbeater.cc:503] Master 127.14.146.252:33449 was elected leader, sending a full tablet report...
I20260808 21:01:44.896903 26085 heartbeater.cc:503] Master 127.14.146.252:33449 was elected leader, sending a full tablet report...
I20260808 21:01:44.897437 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.897296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:57979)
0808 21:01:44.897382 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.897410 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 21:01:44.945539 26663 raft_consensus.cc:482] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:44.945647 26663 raft_consensus.cc:504] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.946084 26663 leader_election.cc:288] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe20b63df900425dba5c9d915078d26c (127.14.146.195:37367), d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723)
I20260808 21:01:44.949199 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.946286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:37367 (local address 127.14.146.194:47595)
0808 21:01:44.946362 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.946374 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:44.946426 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:44.946576 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:44.946577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:44.946579 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:44.946710 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.946712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.947395 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.947396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.948302 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.948304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.948929 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.948931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.949006 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.949010 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:44.949088 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 21:01:44.949129 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 21:01:44.949198 26653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.946389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:47595 (local address 127.14.146.195:37367)
0808 21:01:44.946435 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:44.946437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:44.946448 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:44.946487 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:44.946488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:44.946496 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:44.946570 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:44.946795 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.947291 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.948401 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.948843 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.948929 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.948940 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:44.949098 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 21:01:44.949134 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:01:44.949301 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.946309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34723 (local address 127.14.146.194:59533)
0808 21:01:44.946498 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.946515 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:44.946593 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:44.946765 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:44.946765 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:44.946767 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:44.946829 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.946831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.947498 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.947499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.948436 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:44.948439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.949046 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.949047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:44.949112 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.949116 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:44.949184 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 21:01:44.949228 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":76,"thread_start_us":124,"threads_started":1}
I20260808 21:01:44.949294 26654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.946383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:59533 (local address 127.14.146.193:34723)
0808 21:01:44.946437 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:44.946439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:44.946582 (+ 143us) server_negotiation.cc:407] Connection header received
0808 21:01:44.946686 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:44.946686 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:44.946695 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:44.946759 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:44.946910 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.947380 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.948572 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.948937 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.949024 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.949035 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:44.949191 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 21:01:44.949232 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 21:01:44.949630 26013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad546a6f824048798efd824502c0a4da" candidate_uuid: "eb9ebcfd392c443c8fb57360332ceef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" is_pre_election: true
I20260808 21:01:44.949609 26432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad546a6f824048798efd824502c0a4da" candidate_uuid: "eb9ebcfd392c443c8fb57360332ceef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe20b63df900425dba5c9d915078d26c" is_pre_election: true
I20260808 21:01:44.949731 26013 raft_consensus.cc:2454] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9ebcfd392c443c8fb57360332ceef5 in term 0.
I20260808 21:01:44.949772 26432 raft_consensus.cc:2454] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb9ebcfd392c443c8fb57360332ceef5 in term 0.
I20260808 21:01:44.949903 26117 leader_election.cc:302] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1c8b3857c2c47bcab2f0b01d27d2e0c, eb9ebcfd392c443c8fb57360332ceef5; no voters:
I20260808 21:01:44.950064 26663 raft_consensus.cc:2781] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:44.950105 26663 raft_consensus.cc:482] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:44.950120 26663 raft_consensus.cc:3037] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:44.950847 26663 raft_consensus.cc:504] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.950984 26663 leader_election.cc:288] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [CANDIDATE]: Term 1 election: Requested vote from peers fe20b63df900425dba5c9d915078d26c (127.14.146.195:37367), d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723)
I20260808 21:01:44.951110 26432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad546a6f824048798efd824502c0a4da" candidate_uuid: "eb9ebcfd392c443c8fb57360332ceef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe20b63df900425dba5c9d915078d26c"
I20260808 21:01:44.951134 26013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad546a6f824048798efd824502c0a4da" candidate_uuid: "eb9ebcfd392c443c8fb57360332ceef5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c"
I20260808 21:01:44.951195 26013 raft_consensus.cc:3037] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:44.951193 26432 raft_consensus.cc:3037] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:44.951974 26013 raft_consensus.cc:2454] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9ebcfd392c443c8fb57360332ceef5 in term 1.
I20260808 21:01:44.951974 26432 raft_consensus.cc:2454] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb9ebcfd392c443c8fb57360332ceef5 in term 1.
I20260808 21:01:44.952160 26117 leader_election.cc:302] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1c8b3857c2c47bcab2f0b01d27d2e0c, eb9ebcfd392c443c8fb57360332ceef5; no voters:
I20260808 21:01:44.952278 26663 raft_consensus.cc:2781] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:44.952471 26663 raft_consensus.cc:686] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 1 LEADER]: Becoming Leader. State: Replica: eb9ebcfd392c443c8fb57360332ceef5, State: Running, Role: LEADER
I20260808 21:01:44.952553 26663 consensus_queue.cc:237] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } }
I20260808 21:01:44.952757 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.952665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:36221)
0808 21:01:44.952706 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.952732 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 21:01:44.953423 25815 catalog_manager.cc:5495] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb9ebcfd392c443c8fb57360332ceef5 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "eb9ebcfd392c443c8fb57360332ceef5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb9ebcfd392c443c8fb57360332ceef5" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:44.962597 26649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.960572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44836 (local address 127.14.146.194:35485)
0808 21:01:44.960630 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:44.960632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:44.960640 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:44.960676 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:44.960677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:44.960703 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:44.960766 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:44.960860 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.961301 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.961994 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:44.962169 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:44.962219 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:44.962353 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:44.962445 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:44.962498 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:44.962534 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 21:01:44.962551 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:01:44.963608 26013 raft_consensus.cc:1261] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 1 FOLLOWER]: Refusing update from remote peer eb9ebcfd392c443c8fb57360332ceef5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:44.963711 26432 raft_consensus.cc:1261] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 1 FOLLOWER]: Refusing update from remote peer eb9ebcfd392c443c8fb57360332ceef5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:44.964008 26669 consensus_queue.cc:1035] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe20b63df900425dba5c9d915078d26c" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:44.964174 26663 consensus_queue.cc:1035] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c8b3857c2c47bcab2f0b01d27d2e0c" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 34723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:44.965179 26629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.965072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:55905)
0808 21:01:44.965117 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.965146 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 21:01:44.965560 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.965363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:46865)
0808 21:01:44.965498 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.965527 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260808 21:01:44.966037 26675 mvcc.cc:205] Tried to move back new op lower bound from 7316369018729172992 to 7316369018686214144. Current Snapshot: MvccSnapshot[applied={T|T < 7316369018729172992}]
I20260808 21:01:44.966531 26678 mvcc.cc:205] Tried to move back new op lower bound from 7316369018729172992 to 7316369018686214144. Current Snapshot: MvccSnapshot[applied={T|T < 7316369018729172992}]
I20260808 21:01:44.966617 26629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.966479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.195:55531)
0808 21:01:44.966556 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.966590 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 21:01:44.966629 26627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.966498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.193:54829)
0808 21:01:44.966575 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.966603 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 21:01:44.967023 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:44.966008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:40719 (local address 127.14.146.194:37103)
0808 21:01:44.966959 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.966993 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:40719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":934}
I20260808 21:01:44.967499 26680 mvcc.cc:205] Tried to move back new op lower bound from 7316369018729172992 to 7316369018686214144. Current Snapshot: MvccSnapshot[applied={T|T < 7316369018729172992 or (T in {7316369018729172992})}]
I20260808 21:01:44.969161 25815 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:44.969257 25815 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:44.970415 25815 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 235f4379fe2e4e8f98b534bfb927fe30: Sending DeleteTablet for 3 replicas of tablet ad546a6f824048798efd824502c0a4da
I20260808 21:01:44.970731 26199 tablet_service.cc:1514] Processing DeleteTablet for tablet ad546a6f824048798efd824502c0a4da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:44 UTC) from {username='oryx', principal='oryx/127.14.146.252@KRBTEST.COM'} at 127.0.0.1:44830
I20260808 21:01:44.970742 25986 tablet_service.cc:1514] Processing DeleteTablet for tablet ad546a6f824048798efd824502c0a4da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:44 UTC) from {username='oryx', principal='oryx/127.14.146.252@KRBTEST.COM'} at 127.0.0.1:48172
I20260808 21:01:44.970911 26397 tablet_service.cc:1514] Processing DeleteTablet for tablet ad546a6f824048798efd824502c0a4da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:44 UTC) from {username='oryx', principal='oryx/127.14.146.252@KRBTEST.COM'} at 127.0.0.1:58832
I20260808 21:01:44.970957 26691 tablet_replica.cc:330] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: stopping tablet replica
I20260808 21:01:44.971012 26691 raft_consensus.cc:2229] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:44.971086 26691 raft_consensus.cc:2258] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:44.971089 26695 tablet_replica.cc:330] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: stopping tablet replica
I20260808 21:01:44.971216 26690 tablet_replica.cc:330] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c: stopping tablet replica
I20260808 21:01:44.971138 26695 raft_consensus.cc:2229] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:44.971272 26690 raft_consensus.cc:2229] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:44.971300 26695 raft_consensus.cc:2258] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:44.971312 26690 raft_consensus.cc:2258] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:44.971598 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 25895
I20260808 21:01:44.971604 26690 ts_tablet_manager.cc:1905] T ad546a6f824048798efd824502c0a4da P d1c8b3857c2c47bcab2f0b01d27d2e0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:44.986989 26691 ts_tablet_manager.cc:1905] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:44.988740 26691 ts_tablet_manager.cc:1918] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:44.988801 26691 log.cc:1196] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/ad546a6f824048798efd824502c0a4da
I20260808 21:01:44.989038 26691 ts_tablet_manager.cc:1939] T ad546a6f824048798efd824502c0a4da P eb9ebcfd392c443c8fb57360332ceef5: Deleting consensus metadata
I20260808 21:01:44.989585 25796 catalog_manager.cc:4841] TS eb9ebcfd392c443c8fb57360332ceef5 (127.14.146.194:35485): tablet ad546a6f824048798efd824502c0a4da (table test-table [id=6818c42d509a4033afb5536f3f768d55]) successfully deleted
I20260808 21:01:44.990207 26695 ts_tablet_manager.cc:1905] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:44.991755 26695 ts_tablet_manager.cc:1918] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:44.991818 26695 log.cc:1196] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/ad546a6f824048798efd824502c0a4da
W20260808 21:01:44.991922 26632 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:44.991438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:34723 (local address 127.0.0.1:48174)
0808 21:01:44.991502 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:44.991515 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:44.991582 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:44.991859 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:34723: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 21:01:44.992113 26695 ts_tablet_manager.cc:1939] T ad546a6f824048798efd824502c0a4da P fe20b63df900425dba5c9d915078d26c: Deleting consensus metadata
I20260808 21:01:44.992106 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 26093
I20260808 21:01:44.994266 25799 catalog_manager.cc:4841] TS fe20b63df900425dba5c9d915078d26c (127.14.146.195:37367): tablet ad546a6f824048798efd824502c0a4da (table test-table [id=6818c42d509a4033afb5536f3f768d55]) successfully deleted
W20260808 21:01:44.996893 25796 catalog_manager.cc:4584] TS d1c8b3857c2c47bcab2f0b01d27d2e0c (127.14.146.193:34723): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ad546a6f824048798efd824502c0a4da: Network error: Client connection negotiation failed: client connection to 127.14.146.193:34723: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 21:01:45.001068 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 26305
I20260808 21:01:45.012820 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 25351
I20260808 21:01:45.022838 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 25628
2026-08-08T21:01:45Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6783 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:45 dist-test-slave-t3q3 krb5kdc[26699](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:45 dist-test-slave-t3q3 krb5kdc[26699](info): set up 2 sockets
Aug 08 21:01:45 dist-test-slave-t3q3 krb5kdc[26699](info): commencing operation
krb5kdc: starting...
W20260808 21:01:46.298780 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:46 dist-test-slave-t3q3 krb5kdc[26699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:46Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.254.keytab.
Entry for principal oryx/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.254.keytab.
I20260808 21:01:46.419531 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43411
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.254.keytab
--principal=oryx/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:43411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:46.502363 26716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:46.502609 26716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:46.502650 26716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:46.503830 26716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:46.503901 26716 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 21:01:46.503923 26716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:46.503944 26716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:46.503978 26716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:46.503999 26716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:46.505591 26716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:43411
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.254.keytab
--principal=oryx/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:46.505877 26716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:46.506112 26716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:46.511160 26721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:46.511149 26726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:46.511277 26716 server_base.cc:1034] running on GCE node
W20260808 21:01:46.511149 26722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:46.511677 26716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:46.511968 26716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:46.513293 26716 hybrid_clock.cc:648] HybridClock initialized: now 1786222906513275 us; error 28 us; skew 500 ppm
Aug 08 21:01:46 dist-test-slave-t3q3 krb5kdc[26699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222906, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:46.515807 26716 init.cc:377] Logged in from keytab as oryx/127.14.146.254@KRBTEST.COM (short username oryx)
I20260808 21:01:46.516319 26716 webserver.cc:460] Webserver started at http://127.14.146.254:45481/ using document root <none> and password file <none>
I20260808 21:01:46.516549 26716 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:46.516618 26716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:46.516803 26716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:46.517879 26716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "29928f1b76c34e1480df51042f225347"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "f6af05c85004d96ef782102ba05fc062"
server_key_iv: "7db52871c2a4eaa14dd62863812997da"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.518254 26716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "29928f1b76c34e1480df51042f225347"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "f6af05c85004d96ef782102ba05fc062"
server_key_iv: "7db52871c2a4eaa14dd62863812997da"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.519580 26716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 21:01:46.520357 26738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:46.520524 26716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:46.520632 26716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "29928f1b76c34e1480df51042f225347"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "f6af05c85004d96ef782102ba05fc062"
server_key_iv: "7db52871c2a4eaa14dd62863812997da"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.520715 26716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:46.529256 26716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:46.530977 26716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:46.531138 26716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:46.536181 26716 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:43411
I20260808 21:01:46.536221 26847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:43411 every 8 connection(s)
I20260808 21:01:46.536589 26716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:46.537325 26848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:46.539556 26848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: Bootstrap starting.
I20260808 21:01:46.540184 26848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:46.540449 26848 log.cc:824] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:46.541093 26848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: No bootstrap required, opened a new log
I20260808 21:01:46.543107 26848 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29928f1b76c34e1480df51042f225347" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43411 } }
I20260808 21:01:46.543243 26848 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:46.543265 26848 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29928f1b76c34e1480df51042f225347, State: Initialized, Role: FOLLOWER
I20260808 21:01:46.543401 26848 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29928f1b76c34e1480df51042f225347" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43411 } }
I20260808 21:01:46.543483 26848 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:46.543507 26848 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:46.543535 26848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:46.544023 26848 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29928f1b76c34e1480df51042f225347" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43411 } }
I20260808 21:01:46.544169 26848 leader_election.cc:302] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29928f1b76c34e1480df51042f225347; no voters:
I20260808 21:01:46.544301 26848 leader_election.cc:288] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:46.544418 26852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:46.544565 26848 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:46.544564 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 26716
I20260808 21:01:46.544595 26852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [term 1 LEADER]: Becoming Leader. State: Replica: 29928f1b76c34e1480df51042f225347, State: Running, Role: LEADER
I20260808 21:01:46.544651 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:46.544765 26852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29928f1b76c34e1480df51042f225347" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43411 } }
I20260808 21:01:46.544871 14923 external_mini_cluster.cc:1428] Setting key dc852fe27a2ef344dda83a018a75ea48
I20260808 21:01:46.545126 26856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29928f1b76c34e1480df51042f225347" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29928f1b76c34e1480df51042f225347" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43411 } } }
I20260808 21:01:46.545230 26856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:46.545392 26857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29928f1b76c34e1480df51042f225347. Latest consensus state: current_term: 1 leader_uuid: "29928f1b76c34e1480df51042f225347" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29928f1b76c34e1480df51042f225347" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43411 } } }
I20260808 21:01:46.545445 26857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347 [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:46.545858 26863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:46.546459 26863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:46.548188 26863 catalog_manager.cc:1347] Generated new cluster ID: 8427e0e7d90847b98be556c5afa2a699
I20260808 21:01:46.548249 26863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:01:46 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:46.557176 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.545535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40526 (local address 127.14.146.254:43411)
0808 21:01:46.545704 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:46.545715 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:46.545977 (+ 262us) server_negotiation.cc:407] Connection header received
0808 21:01:46.546128 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:46.546135 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:46.546201 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:46.546353 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:46.547241 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.548580 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.549385 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.550081 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.550224 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.553231 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:46.553235 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:46.553236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:46.553249 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:46.555457 (+ 2208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.555901 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.555905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.555906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.556034 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.556305 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.556306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.556307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.556563 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:46.556760 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:46.556829 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 21:01:46.556972 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":61,"threads_started":1}
I20260808 21:01:46.570963 26863 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:46.571483 26863 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:46.586453 26863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: Generated new TSK 0
I20260808 21:01:46.586675 26863 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab.
Entry for principal oryx/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab.
I20260808 21:01:46.616250 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43411
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab
--principal=oryx/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:46.699738 26884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:46.699944 26884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:46.699968 26884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:46.701206 26884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:46.701249 26884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:46.701270 26884 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:46.701288 26884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:46.702749 26884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab
--principal=oryx/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:43411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:46.702936 26884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:46.703156 26884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:46.708354 26893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:46.708390 26889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:46.708390 26891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:46.708564 26884 server_base.cc:1034] running on GCE node
I20260808 21:01:46.708817 26884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:46.709064 26884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:46.710245 26884 hybrid_clock.cc:648] HybridClock initialized: now 1786222906710224 us; error 37 us; skew 500 ppm
Aug 08 21:01:46 dist-test-slave-t3q3 krb5kdc[26699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222906, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:46.713080 26884 init.cc:377] Logged in from keytab as oryx/127.14.146.193@KRBTEST.COM (short username oryx)
I20260808 21:01:46.713505 26884 webserver.cc:460] Webserver started at http://127.14.146.193:42717/ using document root <none> and password file <none>
I20260808 21:01:46.713725 26884 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:46.713768 26884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:46.713857 26884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:46.714884 26884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "bebb0574246d469f9b9f03990816ab8b"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "8f711d1af5add41169edb9d7538e76d9"
server_key_iv: "2a1c51e405bd7017261185de2b3d9f97"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.715200 26884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "bebb0574246d469f9b9f03990816ab8b"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "8f711d1af5add41169edb9d7538e76d9"
server_key_iv: "2a1c51e405bd7017261185de2b3d9f97"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.716614 26884 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 21:01:46.717396 26905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:46.717612 26884 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:46.717720 26884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "bebb0574246d469f9b9f03990816ab8b"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "8f711d1af5add41169edb9d7538e76d9"
server_key_iv: "2a1c51e405bd7017261185de2b3d9f97"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.717795 26884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:46.724876 26884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:46.727174 26884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:46.727339 26884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:46.727854 26884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:46.727895 26884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:46.727919 26884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:46.727965 26884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:46.735260 26884 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:44673
I20260808 21:01:46.735760 26884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
Aug 08 21:01:46 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222906, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:46.740279 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 26884
I20260808 21:01:46.740391 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:46.740638 14923 external_mini_cluster.cc:1428] Setting key a55b3730df87fe3b43c793fd79a45cf3
I20260808 21:01:46.737442 27094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:44673 every 8 connection(s)
I20260808 21:01:46.741925 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.728398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:42539 (local address 127.14.146.254:43411)
0808 21:01:46.728482 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:46.728485 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:46.730555 (+ 2070us) server_negotiation.cc:407] Connection header received
0808 21:01:46.731353 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:46.731354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:46.731369 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:46.731423 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:46.732355 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.733167 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.734827 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.735191 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.735270 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.738075 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:46.738077 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:46.738077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:46.738086 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:46.739833 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.740414 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.740415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.740416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.740487 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.740807 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.740808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.740809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.740978 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:46.741368 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:46.741731 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 21:01:46.741832 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 21:01:46.742190 26918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.728427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43411 (local address 127.14.146.193:42539)
0808 21:01:46.730387 (+ 1960us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:46.730451 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:46.731237 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:46.731564 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:46.731569 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:46.731912 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:46.732234 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:46.732241 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.733301 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.733303 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:46.734718 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:46.734722 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.735351 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.735353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:46.735536 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.736157 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:46.736168 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:46.737957 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:46.739931 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:46.739939 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:46.739941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:46.740309 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:46.740565 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:46.740566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:46.740566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:46.740727 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:46.741397 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:46.741402 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:46.741559 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 21:01:46.741660 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 21:01:46.741825 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1908,"thread_start_us":82,"threads_started":1}
I20260808 21:01:46.742698 27095 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43411
I20260808 21:01:46.742777 27095 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:46.742955 27095 heartbeater.cc:511] Master 127.14.146.254:43411 requested a full tablet report, sending...
I20260808 21:01:46.743494 26770 ts_manager.cc:194] Registered new tserver with Master: bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673)
I20260808 21:01:46.744439 26770 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:42539
I20260808 21:01:46.752696 27106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.745207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43411 (local address 127.14.146.193:41277)
0808 21:01:46.745553 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:46.745564 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:46.745692 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:46.745923 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:46.745924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:46.746141 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:46.746231 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:46.746233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.747239 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.747240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:46.748113 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:46.748116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.748621 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.748622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:46.748696 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.749178 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:46.749182 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:46.749574 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:46.751602 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:46.751603 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:46.751604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:46.751779 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:46.751988 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:46.751988 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:46.751989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:46.752051 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:46.752334 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:46.752335 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:46.752381 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 21:01:46.752484 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 21:01:46.752589 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":69,"threads_started":1}
I20260808 21:01:46.752689 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.745074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:41277 (local address 127.14.146.254:43411)
0808 21:01:46.745113 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:46.745115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:46.745658 (+ 543us) server_negotiation.cc:407] Connection header received
0808 21:01:46.745813 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:46.745814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:46.745826 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:46.745858 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:46.746353 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.747112 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.748191 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.748511 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.748585 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.750003 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:46.750004 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:46.750005 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:46.750012 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:46.751496 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.751853 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.751854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.751854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.751912 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.752145 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.752146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.752146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.752263 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:46.752341 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:46.752511 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 21:01:46.752587 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for oryx/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab.
Entry for principal oryx/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab.
I20260808 21:01:46.771149 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43411
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab
--principal=oryx/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:46.853729 27112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:46.853950 27112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:46.853974 27112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:46.855063 27112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:46.855098 27112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:46.855118 27112 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:46.855135 27112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:46.856593 27112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab
--principal=oryx/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:43411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:46.856787 27112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:46.856963 27112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 21:01:46.862087 27112 server_base.cc:1034] running on GCE node
W20260808 21:01:46.862030 27122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:46.862018 27120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:46.862040 27119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:46.862534 27112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:46.862802 27112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:46.863945 27112 hybrid_clock.cc:648] HybridClock initialized: now 1786222906863931 us; error 28 us; skew 500 ppm
Aug 08 21:01:46 dist-test-slave-t3q3 krb5kdc[26699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222906, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:46.866396 27112 init.cc:377] Logged in from keytab as oryx/127.14.146.194@KRBTEST.COM (short username oryx)
I20260808 21:01:46.866870 27112 webserver.cc:460] Webserver started at http://127.14.146.194:43087/ using document root <none> and password file <none>
I20260808 21:01:46.867063 27112 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:46.867103 27112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:46.867193 27112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:46.868263 27112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "a4a0408d9e50497dac8dbe18bf5cb822"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "9dc4c629f36732e4ef6a758a418d8865"
server_key_iv: "20a1e1fd62d6b426060bb0c9a8f61377"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.868572 27112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "a4a0408d9e50497dac8dbe18bf5cb822"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "9dc4c629f36732e4ef6a758a418d8865"
server_key_iv: "20a1e1fd62d6b426060bb0c9a8f61377"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.869835 27112 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:46.870587 27134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:46.870785 27112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:46.870896 27112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "a4a0408d9e50497dac8dbe18bf5cb822"
format_stamp: "Formatted at 2026-08-08 21:01:46 on dist-test-slave-t3q3"
server_key: "9dc4c629f36732e4ef6a758a418d8865"
server_key_iv: "20a1e1fd62d6b426060bb0c9a8f61377"
server_key_version: "encryptionkey@0"
I20260808 21:01:46.870972 27112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:46.889628 27112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:46.891647 27112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:46.891816 27112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:46.892465 27112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:46.892526 27112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:46.892557 27112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:46.892589 27112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 21:01:46 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222906, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:46.899883 27112 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:37707
I20260808 21:01:46.899950 27316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:37707 every 8 connection(s)
I20260808 21:01:46.900309 27112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:46.902642 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.892832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:32809 (local address 127.14.146.254:43411)
0808 21:01:46.892877 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:46.892879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:46.893170 (+ 291us) server_negotiation.cc:407] Connection header received
0808 21:01:46.893793 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:46.893795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:46.893809 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:46.893862 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:46.894459 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.894963 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.896050 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.896324 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.896409 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.899814 (+ 3405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:46.899816 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:46.899816 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:46.899824 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:46.901421 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.901786 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.901786 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.901787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.901839 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.902118 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.902118 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.902119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.902224 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:46.902274 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:46.902517 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 21:01:46.902579 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:01:46.902801 27148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.892830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43411 (local address 127.14.146.194:32809)
0808 21:01:46.893013 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:46.893060 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:46.893674 (+ 614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:46.893930 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:46.893933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:46.894176 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:46.894355 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:46.894359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.895069 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.895070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:46.895950 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:46.895953 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.896426 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.896427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:46.896578 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.897139 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:46.897150 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:46.899718 (+ 2568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:46.901496 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:46.901500 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:46.901502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:46.901709 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:46.901923 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:46.901924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:46.901924 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:46.902047 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:46.902284 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:46.902289 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:46.902401 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 21:01:46.902494 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 21:01:46.902616 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
I20260808 21:01:46.903322 27317 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43411
I20260808 21:01:46.903420 27317 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:46.903590 27317 heartbeater.cc:511] Master 127.14.146.254:43411 requested a full tablet report, sending...
I20260808 21:01:46.904080 26768 ts_manager.cc:194] Registered new tserver with Master: a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707)
I20260808 21:01:46.904644 26768 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:32809
I20260808 21:01:46.906710 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 27112
I20260808 21:01:46.906847 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:46.907095 14923 external_mini_cluster.cc:1428] Setting key b7eeec03d94d18cec5405fa06ba7a24f
I20260808 21:01:46.910079 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.904500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:36827 (local address 127.14.146.254:43411)
0808 21:01:46.904542 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:46.904544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:46.904643 (+ 99us) server_negotiation.cc:407] Connection header received
0808 21:01:46.904705 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:46.904706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:46.904717 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:46.904783 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:46.905130 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.905726 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.906387 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.906588 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.906639 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.907510 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:46.907511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:46.907511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:46.907517 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:46.908876 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.909271 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.909272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.909272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.909322 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:46.909515 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:46.909515 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:46.909516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:46.909683 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:46.909763 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:46.909928 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 21:01:46.909993 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:01:46.910097 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:46.904388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43411 (local address 127.14.146.194:36827)
0808 21:01:46.904571 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:46.904581 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:46.904640 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:46.904827 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:46.904828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:46.905002 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:46.905053 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:46.905054 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.905816 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.905817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:46.906317 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:46.906319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:46.906667 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:46.906668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:46.906739 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:46.907112 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:46.907117 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:46.907442 (+ 325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:46.908954 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:46.908955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:46.908955 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:46.909192 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:46.909382 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:46.909383 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:46.909383 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:46.909455 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:46.909758 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:46.909759 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:46.909808 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 21:01:46.909889 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:01:46.909993 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":79,"threads_started":1}
WARNING: no policy specified for oryx/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab.
Entry for principal oryx/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab.
I20260808 21:01:46.934463 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43411
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab
--principal=oryx/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:47.018627 27332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:47.018872 27332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:47.018915 27332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:47.020107 27332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:47.020176 27332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:47.020215 27332 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 21:01:47.020278 27332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:47.022010 27332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab
--principal=oryx/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.146.254:43411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:47.022279 27332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:47.022513 27332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:47.027674 27339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:47.027699 27342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:47.027689 27340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:47.028013 27332 server_base.cc:1034] running on GCE node
I20260808 21:01:47.028283 27332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:47.028556 27332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:47.029718 27332 hybrid_clock.cc:648] HybridClock initialized: now 1786222907029700 us; error 28 us; skew 500 ppm
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222907, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:47.032313 27332 init.cc:377] Logged in from keytab as oryx/127.14.146.195@KRBTEST.COM (short username oryx)
I20260808 21:01:47.032796 27332 webserver.cc:460] Webserver started at http://127.14.146.195:40069/ using document root <none> and password file <none>
I20260808 21:01:47.033047 27332 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:47.033094 27332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:47.033275 27332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:47.034323 27332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "416307a9815648cf857d8366dd1a42e5"
format_stamp: "Formatted at 2026-08-08 21:01:47 on dist-test-slave-t3q3"
server_key: "c832132273d1b3eb2058ddc437949f83"
server_key_iv: "f61f76772c7137bc5cd7a98132cc50fb"
server_key_version: "encryptionkey@0"
I20260808 21:01:47.034690 27332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "416307a9815648cf857d8366dd1a42e5"
format_stamp: "Formatted at 2026-08-08 21:01:47 on dist-test-slave-t3q3"
server_key: "c832132273d1b3eb2058ddc437949f83"
server_key_iv: "f61f76772c7137bc5cd7a98132cc50fb"
server_key_version: "encryptionkey@0"
I20260808 21:01:47.036013 27332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:47.036800 27354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:47.036990 27332 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:47.037081 27332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "416307a9815648cf857d8366dd1a42e5"
format_stamp: "Formatted at 2026-08-08 21:01:47 on dist-test-slave-t3q3"
server_key: "c832132273d1b3eb2058ddc437949f83"
server_key_iv: "f61f76772c7137bc5cd7a98132cc50fb"
server_key_version: "encryptionkey@0"
I20260808 21:01:47.037135 27332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:47.046838 27332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:47.049114 27332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:47.049293 27332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:47.049826 27332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:47.049881 27332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:47.049906 27332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:47.049945 27332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:47.056746 27332 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:43853
I20260808 21:01:47.056799 27533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:43853 every 8 connection(s)
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222907, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:47.057157 27332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:01:47.060029 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 27332
I20260808 21:01:47.060189 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:47.060393 14923 external_mini_cluster.cc:1428] Setting key e218390859fb99c10a72f7ee1dbeb5a9
I20260808 21:01:47.060634 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.050292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:38157 (local address 127.14.146.254:43411)
0808 21:01:47.050335 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.050337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.050624 (+ 287us) server_negotiation.cc:407] Connection header received
0808 21:01:47.051162 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.051164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.051178 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.051242 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:47.052090 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.052923 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.054657 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.054886 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.054942 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.057772 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:47.057773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:47.057774 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:47.057781 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:47.059258 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.059616 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.059616 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.059617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.059684 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.059893 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.059894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.059894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.059995 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:47.060097 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.060451 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.060543 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:01:47.060807 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.050280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43411 (local address 127.14.146.195:38157)
0808 21:01:47.050500 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.050547 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.051046 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.051317 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.051322 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.051701 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:47.051983 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.051991 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.053048 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.053050 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.054551 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.054555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.054986 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.054987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.055146 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.055764 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:47.055774 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:47.057660 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:47.059332 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:47.059337 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:47.059339 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:47.059545 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:47.059745 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:47.059746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:47.059746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:47.059838 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:47.060094 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:47.060102 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:47.060294 (+ 192us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.060426 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.060580 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":81,"threads_started":1}
I20260808 21:01:47.061311 27534 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43411
I20260808 21:01:47.061395 27534 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:47.061620 27534 heartbeater.cc:511] Master 127.14.146.254:43411 requested a full tablet report, sending...
I20260808 21:01:47.062021 26768 ts_manager.cc:194] Registered new tserver with Master: 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853)
I20260808 21:01:47.062484 26768 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:38157
I20260808 21:01:47.067050 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.062326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43411 (local address 127.14.146.195:58593)
0808 21:01:47.062470 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.062481 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.062546 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.062689 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.062690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.062912 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:47.062979 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.062981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.063596 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.063597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.064116 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.064118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.064436 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.064436 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.064483 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.064811 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:47.064815 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:47.065062 (+ 247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:47.066286 (+ 1224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:47.066287 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:47.066287 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:47.066446 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:47.066595 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:47.066595 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:47.066595 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:47.066635 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:47.066827 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:47.066828 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:47.066863 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.066914 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.066984 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260808 21:01:47.067075 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.062409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:58593 (local address 127.14.146.254:43411)
0808 21:01:47.062451 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.062453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.062529 (+ 76us) server_negotiation.cc:407] Connection header received
0808 21:01:47.062595 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.062595 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.062604 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.062675 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:47.063062 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.063506 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.064198 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.064371 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.064425 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.065134 (+ 709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:47.065135 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:47.065135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:47.065141 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:47.066220 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.066507 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.066507 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.066508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.066556 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.066671 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.066671 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.066671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.066775 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:47.066821 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.066961 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.067019 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:47.072233 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222907, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 21:01:47.094569 26867 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:47.089163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40538 (local address 127.14.146.254:43411)
0808 21:01:47.089252 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.089255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.089271 (+ 16us) server_negotiation.cc:407] Connection header received
0808 21:01:47.089375 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.089377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.089390 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.089455 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:47.090037 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.090529 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.091265 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.091452 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.091507 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.094471 (+ 2964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40538: BlockingRecv error: recv got EOF from 127.0.0.1:40538 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222907, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:47.102077 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.095342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.14.146.254:43411)
0808 21:01:47.095408 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.095411 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.095466 (+ 55us) server_negotiation.cc:407] Connection header received
0808 21:01:47.095530 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.095530 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.095540 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.095588 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:47.096208 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.096681 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.097361 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.097557 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.097629 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.099649 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:47.099650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:47.099651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:47.099658 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:47.100934 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.101291 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.101292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.101293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.101350 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.101553 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.101554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.101554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.101661 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:47.101762 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.101899 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.101974 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 21:01:47.103775 26768 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:47.105629 26768 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:47.112236 27570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.107836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:37707 (local address 127.0.0.1:58788)
0808 21:01:47.107933 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.107973 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.108040 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.108847 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.108848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.108850 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:47.108891 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.108893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.110109 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.110110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.110995 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.110997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.111971 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.111972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.112025 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.112029 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.112110 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.112144 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"thread_start_us":56,"threads_started":1}
I20260808 21:01:47.112149 27572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.107864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44673 (local address 127.0.0.1:37992)
0808 21:01:47.108326 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.108334 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.108370 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.108681 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.108682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.108683 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:47.108728 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.108729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.109675 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.109677 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.111057 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.111061 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.111778 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.111779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.111858 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.111872 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.111977 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.112031 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"mutex_wait_us":50,"thread_start_us":66,"threads_started":1}
I20260808 21:01:47.112355 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.108337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37992 (local address 127.14.146.193:44673)
0808 21:01:47.108527 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.108532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.108543 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:47.108580 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.108582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.108599 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.108812 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:47.108941 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.109587 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.111164 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.111664 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.111793 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.111861 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.112195 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.112240 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":90,"threads_started":1}
I20260808 21:01:47.112437 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.108100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42030 (local address 127.14.146.195:43853)
0808 21:01:47.108295 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.108300 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.108311 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:47.108354 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.108356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.108372 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.108461 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:47.108644 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.109731 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.111133 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.111826 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.111922 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.111982 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.112275 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.112319 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":119,"threads_started":1}
I20260808 21:01:47.112484 27573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.107841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43853 (local address 127.0.0.1:42030)
0808 21:01:47.108182 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.108193 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.108252 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.108490 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.108494 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.108496 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:47.108561 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.108563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.109824 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.109825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.111058 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.111061 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.112020 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.112021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.112123 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.112127 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.112188 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.112230 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":25,"thread_start_us":84,"threads_started":1}
I20260808 21:01:47.113029 27575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.108111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58788 (local address 127.14.146.194:37707)
0808 21:01:47.108556 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.108561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.108570 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:47.108709 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.108711 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.108729 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.108993 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:47.109050 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.110023 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.111085 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.111826 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.111968 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.112022 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.112127 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.112175 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":95,"threads_started":1}
I20260808 21:01:47.113291 27433 tablet_service.cc:1467] Processing CreateTablet for tablet 485a230206944d5d805c08257baa661a (DEFAULT_TABLE table=test-table [id=bcc88152d4b54a2f8d277e143963b104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.113360 26986 tablet_service.cc:1467] Processing CreateTablet for tablet 485a230206944d5d805c08257baa661a (DEFAULT_TABLE table=test-table [id=bcc88152d4b54a2f8d277e143963b104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.113709 26986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485a230206944d5d805c08257baa661a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.113740 27433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485a230206944d5d805c08257baa661a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.114197 27215 tablet_service.cc:1467] Processing CreateTablet for tablet 485a230206944d5d805c08257baa661a (DEFAULT_TABLE table=test-table [id=bcc88152d4b54a2f8d277e143963b104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.114539 27215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 485a230206944d5d805c08257baa661a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.117646 27578 tablet_bootstrap.cc:492] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Bootstrap starting.
I20260808 21:01:47.118072 27580 tablet_bootstrap.cc:492] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Bootstrap starting.
I20260808 21:01:47.118400 27578 tablet_bootstrap.cc:654] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.118645 27578 log.cc:824] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:47.118664 27580 tablet_bootstrap.cc:654] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.118968 27580 log.cc:824] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:47.119324 27579 tablet_bootstrap.cc:492] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: Bootstrap starting.
I20260808 21:01:47.119549 27578 tablet_bootstrap.cc:492] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: No bootstrap required, opened a new log
I20260808 21:01:47.119633 27578 ts_tablet_manager.cc:1397] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:47.119745 27580 tablet_bootstrap.cc:492] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: No bootstrap required, opened a new log
I20260808 21:01:47.119810 27580 ts_tablet_manager.cc:1397] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:47.120713 27579 tablet_bootstrap.cc:654] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.121125 27579 log.cc:824] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:47.121331 27578 raft_consensus.cc:348] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.121501 27578 raft_consensus.cc:374] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.121589 27578 raft_consensus.cc:729] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4a0408d9e50497dac8dbe18bf5cb822, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.121730 27578 consensus_queue.cc:260] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.122008 27578 ts_tablet_manager.cc:1428] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 21:01:47.122012 27579 tablet_bootstrap.cc:492] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: No bootstrap required, opened a new log
I20260808 21:01:47.122090 27579 ts_tablet_manager.cc:1397] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 21:01:47.122164 27317 heartbeater.cc:503] Master 127.14.146.254:43411 was elected leader, sending a full tablet report...
I20260808 21:01:47.122133 27580 raft_consensus.cc:348] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.122277 27580 raft_consensus.cc:374] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.122313 27580 raft_consensus.cc:729] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebb0574246d469f9b9f03990816ab8b, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.122435 27580 consensus_queue.cc:260] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.122797 27580 ts_tablet_manager.cc:1428] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:01:47.122948 27095 heartbeater.cc:503] Master 127.14.146.254:43411 was elected leader, sending a full tablet report...
I20260808 21:01:47.124174 27579 raft_consensus.cc:348] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.124312 27579 raft_consensus.cc:374] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.124363 27579 raft_consensus.cc:729] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416307a9815648cf857d8366dd1a42e5, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.124473 27579 consensus_queue.cc:260] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.124713 27579 ts_tablet_manager.cc:1428] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:01:47.124778 27534 heartbeater.cc:503] Master 127.14.146.254:43411 was elected leader, sending a full tablet report...
W20260808 21:01:47.150908 27318 tablet.cc:2369] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:01:47.238049 27097 tablet.cc:2369] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:47.247315 27586 raft_consensus.cc:482] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:47.247479 27586 raft_consensus.cc:504] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.247898 27586 leader_election.cc:288] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853), bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673)
I20260808 21:01:47.250893 27148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.248161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44673 (local address 127.14.146.194:55213)
0808 21:01:47.248244 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.248259 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.248319 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.248502 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.248503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.248505 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:47.248589 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.248591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.249238 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.249239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.250043 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.250045 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.250575 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.250576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.250695 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.250698 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.250753 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.250796 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 21:01:47.250953 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.248210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:55213 (local address 127.14.146.193:44673)
0808 21:01:47.248263 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.248266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.248306 (+ 40us) server_negotiation.cc:407] Connection header received
0808 21:01:47.248418 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.248420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.248428 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.248497 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:47.248666 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.249150 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.250138 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.250491 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.250579 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.250588 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.250837 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.250875 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:01:47.251004 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.248268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:59923 (local address 127.14.146.195:43853)
0808 21:01:47.248311 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.248314 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.248478 (+ 164us) server_negotiation.cc:407] Connection header received
0808 21:01:47.248561 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.248562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.248571 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.248642 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:47.248813 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.249285 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.250208 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.250566 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.250645 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.250655 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.250856 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.250921 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:01:47.251235 27594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.248160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43853 (local address 127.14.146.194:59923)
0808 21:01:47.248386 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.248396 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.248490 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.248645 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.248646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.248647 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:47.248739 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.248740 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.249380 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.249381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.250116 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.250118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.250678 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.250679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.250763 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.250767 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.251092 (+ 325us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.251141 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":21,"thread_start_us":113,"threads_started":1}
I20260808 21:01:47.251250 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485a230206944d5d805c08257baa661a" candidate_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebb0574246d469f9b9f03990816ab8b" is_pre_election: true
I20260808 21:01:47.251410 26996 raft_consensus.cc:2454] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4a0408d9e50497dac8dbe18bf5cb822 in term 0.
I20260808 21:01:47.251703 27460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485a230206944d5d805c08257baa661a" candidate_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416307a9815648cf857d8366dd1a42e5" is_pre_election: true
I20260808 21:01:47.251847 27460 raft_consensus.cc:2454] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4a0408d9e50497dac8dbe18bf5cb822 in term 0.
I20260808 21:01:47.252118 27138 leader_election.cc:302] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4a0408d9e50497dac8dbe18bf5cb822, bebb0574246d469f9b9f03990816ab8b; no voters:
I20260808 21:01:47.252252 27586 raft_consensus.cc:2781] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:47.252333 27586 raft_consensus.cc:482] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:47.252377 27586 raft_consensus.cc:3037] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.253113 27586 raft_consensus.cc:504] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.253288 27586 leader_election.cc:288] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [CANDIDATE]: Term 1 election: Requested vote from peers 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853), bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673)
I20260808 21:01:47.253443 27460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485a230206944d5d805c08257baa661a" candidate_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416307a9815648cf857d8366dd1a42e5"
I20260808 21:01:47.253508 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "485a230206944d5d805c08257baa661a" candidate_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebb0574246d469f9b9f03990816ab8b"
I20260808 21:01:47.253526 27460 raft_consensus.cc:3037] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.253583 26996 raft_consensus.cc:3037] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.254418 27460 raft_consensus.cc:2454] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4a0408d9e50497dac8dbe18bf5cb822 in term 1.
I20260808 21:01:47.254418 26996 raft_consensus.cc:2454] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4a0408d9e50497dac8dbe18bf5cb822 in term 1.
I20260808 21:01:47.254586 27138 leader_election.cc:302] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4a0408d9e50497dac8dbe18bf5cb822, bebb0574246d469f9b9f03990816ab8b; no voters:
I20260808 21:01:47.254710 27586 raft_consensus.cc:2781] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:47.254891 27586 raft_consensus.cc:686] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 LEADER]: Becoming Leader. State: Replica: a4a0408d9e50497dac8dbe18bf5cb822, State: Running, Role: LEADER
I20260808 21:01:47.254966 27586 consensus_queue.cc:237] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } }
I20260808 21:01:47.255874 26768 catalog_manager.cc:5495] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:47.292570 27575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.290169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58804 (local address 127.14.146.194:37707)
0808 21:01:47.290239 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.290241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.290249 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:47.290285 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.290286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.290303 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.290374 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:47.290508 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.290985 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.291792 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.292011 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.292116 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.292272 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:47.292381 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:47.292444 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.292488 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.292511 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 21:01:47.294631 26996 raft_consensus.cc:1261] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Refusing update from remote peer a4a0408d9e50497dac8dbe18bf5cb822: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:47.294631 27460 raft_consensus.cc:1261] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Refusing update from remote peer a4a0408d9e50497dac8dbe18bf5cb822: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:47.295055 27595 consensus_queue.cc:1035] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:47.295202 27586 consensus_queue.cc:1035] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:47.299098 27601 mvcc.cc:205] Tried to move back new op lower bound from 7316369028275572736 to 7316369028117032960. Current Snapshot: MvccSnapshot[applied={T|T < 7316369028275572736}]
I20260808 21:01:47.300364 27603 mvcc.cc:205] Tried to move back new op lower bound from 7316369028275572736 to 7316369028117032960. Current Snapshot: MvccSnapshot[applied={T|T < 7316369028275572736 or (T in {7316369028275572736})}]
I20260808 21:01:47.300405 26768 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:47.300503 26768 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:47.301393 26768 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: Sending DeleteTablet for 3 replicas of tablet 485a230206944d5d805c08257baa661a
I20260808 21:01:47.301707 27433 tablet_service.cc:1514] Processing DeleteTablet for tablet 485a230206944d5d805c08257baa661a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:47 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:42030
I20260808 21:01:47.301748 27215 tablet_service.cc:1514] Processing DeleteTablet for tablet 485a230206944d5d805c08257baa661a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:47 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:58788
I20260808 21:01:47.301937 26768 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:47.302083 26768 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:47.302040 26986 tablet_service.cc:1514] Processing DeleteTablet for tablet 485a230206944d5d805c08257baa661a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:47 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:37992
I20260808 21:01:47.302278 27617 tablet_replica.cc:330] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: stopping tablet replica
I20260808 21:01:47.302416 27617 raft_consensus.cc:2229] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:47.302541 27617 raft_consensus.cc:2258] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:47.302836 27615 tablet_replica.cc:330] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: stopping tablet replica
I20260808 21:01:47.303206 27617 ts_tablet_manager.cc:1905] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:47.303546 26986 tablet_service.cc:1467] Processing CreateTablet for tablet 8563502ee60540c69717c771f12580b8 (DEFAULT_TABLE table=test-table [id=939ba74b99c94d80b49a1e4e79d36c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.303691 26986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8563502ee60540c69717c771f12580b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.303911 27433 tablet_service.cc:1467] Processing CreateTablet for tablet 8563502ee60540c69717c771f12580b8 (DEFAULT_TABLE table=test-table [id=939ba74b99c94d80b49a1e4e79d36c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.304013 27433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8563502ee60540c69717c771f12580b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.305056 27617 ts_tablet_manager.cc:1918] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:47.305131 27617 log.cc:1196] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/485a230206944d5d805c08257baa661a
I20260808 21:01:47.305219 27580 tablet_bootstrap.cc:492] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: Bootstrap starting.
I20260808 21:01:47.305414 27617 ts_tablet_manager.cc:1939] T 485a230206944d5d805c08257baa661a P bebb0574246d469f9b9f03990816ab8b: Deleting consensus metadata
I20260808 21:01:47.305426 27579 tablet_bootstrap.cc:492] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: Bootstrap starting.
I20260808 21:01:47.305630 27580 tablet_bootstrap.cc:654] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.305869 27579 tablet_bootstrap.cc:654] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.306277 26743 catalog_manager.cc:4841] TS bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673): tablet 485a230206944d5d805c08257baa661a (table test-table [id=bcc88152d4b54a2f8d277e143963b104]) successfully deleted
I20260808 21:01:47.306567 27215 tablet_service.cc:1467] Processing CreateTablet for tablet 8563502ee60540c69717c771f12580b8 (DEFAULT_TABLE table=test-table [id=939ba74b99c94d80b49a1e4e79d36c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.306627 27579 tablet_bootstrap.cc:492] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: No bootstrap required, opened a new log
I20260808 21:01:47.306663 27580 tablet_bootstrap.cc:492] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: No bootstrap required, opened a new log
I20260808 21:01:47.306669 27579 ts_tablet_manager.cc:1397] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:47.306694 27215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8563502ee60540c69717c771f12580b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.306701 27580 ts_tablet_manager.cc:1397] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:47.306842 27579 raft_consensus.cc:348] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.306908 27579 raft_consensus.cc:374] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.306932 27579 raft_consensus.cc:729] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416307a9815648cf857d8366dd1a42e5, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.306980 27579 consensus_queue.cc:260] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.307058 27579 ts_tablet_manager.cc:1428] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:47.307017 27580 raft_consensus.cc:348] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.307097 27580 raft_consensus.cc:374] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.307124 27580 raft_consensus.cc:729] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebb0574246d469f9b9f03990816ab8b, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.307168 27580 consensus_queue.cc:260] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.307260 27580 ts_tablet_manager.cc:1428] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260808 21:01:47.307847 27535 tablet.cc:2369] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:01:47.308076 27578 tablet_bootstrap.cc:492] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: Bootstrap starting.
I20260808 21:01:47.308117 27615 raft_consensus.cc:2229] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:47.308233 27615 raft_consensus.cc:2258] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:47.308485 27578 tablet_bootstrap.cc:654] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.308547 27616 tablet_replica.cc:330] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: stopping tablet replica
I20260808 21:01:47.308652 27616 raft_consensus.cc:2229] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:47.308753 27616 raft_consensus.cc:2258] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:47.308771 27615 ts_tablet_manager.cc:1905] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:47.309201 27616 ts_tablet_manager.cc:1905] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:47.309808 27578 tablet_bootstrap.cc:492] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: No bootstrap required, opened a new log
I20260808 21:01:47.309862 27578 ts_tablet_manager.cc:1397] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:47.310009 27578 raft_consensus.cc:348] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.310091 27578 raft_consensus.cc:374] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.310113 27578 raft_consensus.cc:729] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4a0408d9e50497dac8dbe18bf5cb822, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.310158 27578 consensus_queue.cc:260] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.310252 27578 ts_tablet_manager.cc:1428] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:47.310406 27615 ts_tablet_manager.cc:1918] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:47.310484 27615 log.cc:1196] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/485a230206944d5d805c08257baa661a
I20260808 21:01:47.310781 27615 ts_tablet_manager.cc:1939] T 485a230206944d5d805c08257baa661a P 416307a9815648cf857d8366dd1a42e5: Deleting consensus metadata
I20260808 21:01:47.311878 27616 ts_tablet_manager.cc:1918] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:47.311878 26739 catalog_manager.cc:4841] TS 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853): tablet 485a230206944d5d805c08257baa661a (table test-table [id=bcc88152d4b54a2f8d277e143963b104]) successfully deleted
I20260808 21:01:47.311982 27616 log.cc:1196] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/485a230206944d5d805c08257baa661a
I20260808 21:01:47.312304 27616 ts_tablet_manager.cc:1939] T 485a230206944d5d805c08257baa661a P a4a0408d9e50497dac8dbe18bf5cb822: Deleting consensus metadata
I20260808 21:01:47.312711 26741 catalog_manager.cc:4841] TS a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707): tablet 485a230206944d5d805c08257baa661a (table test-table [id=bcc88152d4b54a2f8d277e143963b104]) successfully deleted
I20260808 21:01:47.314141 27592 raft_consensus.cc:482] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:47.314206 27592 raft_consensus.cc:504] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.314491 27592 leader_election.cc:288] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673), a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707)
I20260808 21:01:47.318339 27575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.314919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:45131 (local address 127.14.146.194:37707)
0808 21:01:47.314962 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.314964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.314972 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:47.314994 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.314995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.315004 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.315055 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:47.315247 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.315992 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.317475 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.317897 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.318013 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.318023 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.318228 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.318266 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:01:47.318365 27370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.314630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:37707 (local address 127.14.146.195:45131)
0808 21:01:47.314679 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.314691 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.314756 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.315103 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.315104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.315106 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:47.315168 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.315170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.316102 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.316103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.317369 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.317372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.318023 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.318024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.318141 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.318144 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.318222 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.318273 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 21:01:47.318744 27244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8563502ee60540c69717c771f12580b8" candidate_uuid: "416307a9815648cf857d8366dd1a42e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" is_pre_election: true
I20260808 21:01:47.318894 27244 raft_consensus.cc:2454] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 416307a9815648cf857d8366dd1a42e5 in term 0.
I20260808 21:01:47.319092 27359 leader_election.cc:302] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416307a9815648cf857d8366dd1a42e5, a4a0408d9e50497dac8dbe18bf5cb822; no voters:
I20260808 21:01:47.319226 27592 raft_consensus.cc:2781] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:47.319265 27592 raft_consensus.cc:482] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:47.319293 27592 raft_consensus.cc:3037] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.320119 27622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.314645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44673 (local address 127.14.146.195:55253)
0808 21:01:47.314790 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.314800 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.314845 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.315077 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.315078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.315080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:47.315163 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.315164 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.317476 (+ 2312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.317476 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.318946 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.318949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.319794 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.319795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.319873 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.319878 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.319941 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.319980 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260808 21:01:47.320183 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.314845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:55253 (local address 127.14.146.193:44673)
0808 21:01:47.314913 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.314915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.314924 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:47.314948 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.314949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.314959 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.315025 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:47.315254 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.315992 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.319079 (+ 3087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.319705 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.319793 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.319803 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.319980 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.320028 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 21:01:47.320240 27592 raft_consensus.cc:504] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.320490 27592 leader_election.cc:288] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [CANDIDATE]: Term 1 election: Requested vote from peers bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673), a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707)
I20260808 21:01:47.320649 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8563502ee60540c69717c771f12580b8" candidate_uuid: "416307a9815648cf857d8366dd1a42e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebb0574246d469f9b9f03990816ab8b" is_pre_election: true
I20260808 21:01:47.320766 26996 raft_consensus.cc:2454] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 416307a9815648cf857d8366dd1a42e5 in term 0.
I20260808 21:01:47.320657 26994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8563502ee60540c69717c771f12580b8" candidate_uuid: "416307a9815648cf857d8366dd1a42e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebb0574246d469f9b9f03990816ab8b"
I20260808 21:01:47.320818 26994 raft_consensus.cc:3037] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.321620 26994 raft_consensus.cc:2454] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416307a9815648cf857d8366dd1a42e5 in term 1.
I20260808 21:01:47.321776 27244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8563502ee60540c69717c771f12580b8" candidate_uuid: "416307a9815648cf857d8366dd1a42e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4a0408d9e50497dac8dbe18bf5cb822"
I20260808 21:01:47.321851 27244 raft_consensus.cc:3037] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.321869 27361 leader_election.cc:302] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416307a9815648cf857d8366dd1a42e5, bebb0574246d469f9b9f03990816ab8b; no voters:
I20260808 21:01:47.321969 27592 raft_consensus.cc:2781] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:47.322069 27592 raft_consensus.cc:686] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 1 LEADER]: Becoming Leader. State: Replica: 416307a9815648cf857d8366dd1a42e5, State: Running, Role: LEADER
I20260808 21:01:47.322137 27592 consensus_queue.cc:237] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.322674 27244 raft_consensus.cc:2454] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416307a9815648cf857d8366dd1a42e5 in term 1.
I20260808 21:01:47.322836 26768 catalog_manager.cc:5495] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 416307a9815648cf857d8366dd1a42e5 (127.14.146.195). New cstate: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } health_report { overall_health: HEALTHY } } }
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222906, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.254@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:47.361294 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.353154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40544 (local address 127.14.146.254:43411)
0808 21:01:47.353232 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.353235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.353344 (+ 109us) server_negotiation.cc:407] Connection header received
0808 21:01:47.353416 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.353417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.353429 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.353489 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:47.354005 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.354800 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.355538 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.355856 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.355934 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.358535 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:47.358537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:47.358537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:47.358566 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:47.359895 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.360404 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.360405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.360405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.360459 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.360738 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.360739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.360739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.360882 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:47.360948 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.361139 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.361226 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:01:47.361442 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.353053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43411 (local address 127.0.0.1:40544)
0808 21:01:47.353252 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.353265 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.353340 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.353507 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.353508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.353852 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:47.353909 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.353911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.354904 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.354905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.355444 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.355446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.355957 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.355958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.356011 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.356703 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:47.356708 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:47.358450 (+ 1742us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:47.359985 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:47.360001 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:47.360003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:47.360326 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:47.360532 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:47.360533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:47.360534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:47.360628 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:47.360963 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:47.360973 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:47.361039 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.361121 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.361339 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":77,"thread_start_us":128,"threads_started":1}
I20260808 21:01:47.363580 26768 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:40544:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 21:01:47.363840 26768 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:47.365517 27215 tablet_service.cc:1467] Processing CreateTablet for tablet fcca2aedb0134b20b373edc7cba627f0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=df0a5fefbde147c5bf4c37344d4eda24]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:47.365542 26986 tablet_service.cc:1467] Processing CreateTablet for tablet fcca2aedb0134b20b373edc7cba627f0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=df0a5fefbde147c5bf4c37344d4eda24]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:47.365696 27215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcca2aedb0134b20b373edc7cba627f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.365711 26986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcca2aedb0134b20b373edc7cba627f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.366845 27580 tablet_bootstrap.cc:492] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: Bootstrap starting.
I20260808 21:01:47.367290 27580 tablet_bootstrap.cc:654] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.367308 27578 tablet_bootstrap.cc:492] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: Bootstrap starting.
I20260808 21:01:47.367388 27433 tablet_service.cc:1467] Processing CreateTablet for tablet fcca2aedb0134b20b373edc7cba627f0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=df0a5fefbde147c5bf4c37344d4eda24]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 21:01:47.367538 27433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcca2aedb0134b20b373edc7cba627f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.367630 27578 tablet_bootstrap.cc:654] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.368198 27578 tablet_bootstrap.cc:492] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: No bootstrap required, opened a new log
I20260808 21:01:47.368254 27578 ts_tablet_manager.cc:1397] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:47.368340 27580 tablet_bootstrap.cc:492] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: No bootstrap required, opened a new log
I20260808 21:01:47.368381 27580 ts_tablet_manager.cc:1397] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:47.368374 27578 raft_consensus.cc:348] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.368454 27578 raft_consensus.cc:374] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.368475 27578 raft_consensus.cc:729] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4a0408d9e50497dac8dbe18bf5cb822, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.368518 27578 consensus_queue.cc:260] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.368511 27580 raft_consensus.cc:348] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.368580 27580 raft_consensus.cc:374] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.368600 27580 raft_consensus.cc:729] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebb0574246d469f9b9f03990816ab8b, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.368610 27578 ts_tablet_manager.cc:1428] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:47.368643 27580 consensus_queue.cc:260] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.368736 27580 ts_tablet_manager.cc:1428] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:47.368877 27610 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.368949 27610 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:47.369146 27579 tablet_bootstrap.cc:492] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: Bootstrap starting.
I20260808 21:01:47.369125 27589 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.369207 27589 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:47.369563 27579 tablet_bootstrap.cc:654] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.370270 27579 tablet_bootstrap.cc:492] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: No bootstrap required, opened a new log
I20260808 21:01:47.370326 27579 ts_tablet_manager.cc:1397] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:47.370728 27579 raft_consensus.cc:348] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.370805 27579 raft_consensus.cc:374] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.370824 27579 raft_consensus.cc:729] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416307a9815648cf857d8366dd1a42e5, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.370893 27579 consensus_queue.cc:260] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.370985 27579 ts_tablet_manager.cc:1428] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:47.371091 27592 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.371196 27592 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:47.643589 27592 raft_consensus.cc:482] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:47.643698 27592 raft_consensus.cc:504] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.643872 27592 leader_election.cc:288] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673), a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707)
I20260808 21:01:47.644177 27244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcca2aedb0134b20b373edc7cba627f0" candidate_uuid: "416307a9815648cf857d8366dd1a42e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" is_pre_election: true
I20260808 21:01:47.644284 27244 raft_consensus.cc:2454] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 416307a9815648cf857d8366dd1a42e5 in term 0.
I20260808 21:01:47.644193 26994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcca2aedb0134b20b373edc7cba627f0" candidate_uuid: "416307a9815648cf857d8366dd1a42e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebb0574246d469f9b9f03990816ab8b" is_pre_election: true
I20260808 21:01:47.644332 26994 raft_consensus.cc:2454] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 416307a9815648cf857d8366dd1a42e5 in term 0.
I20260808 21:01:47.644537 27361 leader_election.cc:302] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416307a9815648cf857d8366dd1a42e5, bebb0574246d469f9b9f03990816ab8b; no voters:
I20260808 21:01:47.644658 27592 raft_consensus.cc:2781] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:47.644742 27592 raft_consensus.cc:482] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:47.644775 27592 raft_consensus.cc:3037] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.645565 27592 raft_consensus.cc:504] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.645726 27592 leader_election.cc:288] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [CANDIDATE]: Term 1 election: Requested vote from peers bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673), a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707)
I20260808 21:01:47.645866 26994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcca2aedb0134b20b373edc7cba627f0" candidate_uuid: "416307a9815648cf857d8366dd1a42e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebb0574246d469f9b9f03990816ab8b"
I20260808 21:01:47.645944 26994 raft_consensus.cc:3037] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.645910 27244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcca2aedb0134b20b373edc7cba627f0" candidate_uuid: "416307a9815648cf857d8366dd1a42e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4a0408d9e50497dac8dbe18bf5cb822"
I20260808 21:01:47.645990 27244 raft_consensus.cc:3037] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:47.646628 26994 raft_consensus.cc:2454] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416307a9815648cf857d8366dd1a42e5 in term 1.
I20260808 21:01:47.646687 27244 raft_consensus.cc:2454] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 416307a9815648cf857d8366dd1a42e5 in term 1.
I20260808 21:01:47.646828 27361 leader_election.cc:302] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416307a9815648cf857d8366dd1a42e5, bebb0574246d469f9b9f03990816ab8b; no voters:
I20260808 21:01:47.646957 27592 raft_consensus.cc:2781] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:47.647043 27592 raft_consensus.cc:686] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [term 1 LEADER]: Becoming Leader. State: Replica: 416307a9815648cf857d8366dd1a42e5, State: Running, Role: LEADER
I20260808 21:01:47.647125 27592 consensus_queue.cc:237] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.647454 27623 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: TxnStatusTablet state changed. Reason: New leader 416307a9815648cf857d8366dd1a42e5. Latest consensus state: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.647557 27623 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:47.647722 27640 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 21:01:47.647737 26767 catalog_manager.cc:5495] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 416307a9815648cf857d8366dd1a42e5 (127.14.146.195). New cstate: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } health_report { overall_health: HEALTHY } } }
I20260808 21:01:47.647862 27640 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 21:01:47.654871 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.652316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42042 (local address 127.14.146.195:43853)
0808 21:01:47.652358 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.652360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.652402 (+ 42us) server_negotiation.cc:407] Connection header received
0808 21:01:47.652517 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.652518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.652543 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.652610 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:47.652753 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.653273 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.654053 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.654255 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.654327 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.654516 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:47.654630 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:47.654708 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.654762 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.654784 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:01:47.654888 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.652278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43853 (local address 127.0.0.1:42042)
0808 21:01:47.652351 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.652364 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.652424 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.652619 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.652620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.652621 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:47.652673 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.652675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.653364 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.653365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.653944 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.653946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.654338 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.654340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.654412 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.654425 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:47.654705 (+ 280us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:47.654715 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.654760 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.654811 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 21:01:47.655921 26994 raft_consensus.cc:1261] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Refusing update from remote peer 416307a9815648cf857d8366dd1a42e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:47.656035 27244 raft_consensus.cc:1261] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Refusing update from remote peer 416307a9815648cf857d8366dd1a42e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:47.656280 27592 consensus_queue.cc:1035] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:47.656394 27623 consensus_queue.cc:1035] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:47.657001 27610 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: TxnStatusTablet state changed. Reason: New leader 416307a9815648cf857d8366dd1a42e5. Latest consensus state: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.657007 27589 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: TxnStatusTablet state changed. Reason: New leader 416307a9815648cf857d8366dd1a42e5. Latest consensus state: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.657090 27610 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:47.657090 27589 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:47.657809 27623 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.657886 27623 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:47.657930 27623 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.657979 27623 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P 416307a9815648cf857d8366dd1a42e5: This TxnStatusTablet replica's current role is: LEADER
I20260808 21:01:47.658063 27589 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.658145 27589 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P bebb0574246d469f9b9f03990816ab8b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:47.659196 27600 mvcc.cc:205] Tried to move back new op lower bound from 7316369029756805120 to 7316369029723086848. Current Snapshot: MvccSnapshot[applied={T|T < 7316369029756805120 or (T in {7316369029756805120})}]
I20260808 21:01:47.659442 27610 tablet_replica.cc:439] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "416307a9815648cf857d8366dd1a42e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } } }
I20260808 21:01:47.659538 27610 tablet_replica.cc:442] T fcca2aedb0134b20b373edc7cba627f0 P a4a0408d9e50497dac8dbe18bf5cb822: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 21:01:47.661979 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.659673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42058 (local address 127.14.146.195:43853)
0808 21:01:47.659735 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.659737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.659745 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:47.659765 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.659766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.659777 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.659840 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:47.659973 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.660502 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.661303 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.661507 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.661582 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.661732 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:47.661761 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:47.661829 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.661893 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.661912 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 21:01:47.667254 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.664554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:37263 (local address 127.14.146.195:43853)
0808 21:01:47.664604 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.664606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.664659 (+ 53us) server_negotiation.cc:407] Connection header received
0808 21:01:47.664738 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.664738 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.664746 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.664789 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:47.664961 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.665426 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.666572 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.666757 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.666815 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.667027 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:47.667052 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:47.667097 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.667174 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.667193 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":31}
I20260808 21:01:47.667358 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.664420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43853 (local address 127.14.146.195:37263)
0808 21:01:47.664598 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:47.664610 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:47.664675 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:47.664793 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:47.664794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:47.664804 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:47.664865 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.664866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.665511 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.665512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.666474 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:47.666476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.666836 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.666837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:47.666908 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.666923 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:47.667117 (+ 194us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:47.667119 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:47.667173 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 21:01:47.667220 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260808 21:01:47.669958 27244 raft_consensus.cc:1261] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Refusing update from remote peer 416307a9815648cf857d8366dd1a42e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:47.669999 26994 raft_consensus.cc:1261] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Refusing update from remote peer 416307a9815648cf857d8366dd1a42e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:47.670248 27650 consensus_queue.cc:1035] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:47.670398 27592 consensus_queue.cc:1035] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:47.684715 26767 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:47.684823 26767 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:47.685443 26767 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: Sending DeleteTablet for 3 replicas of tablet 8563502ee60540c69717c771f12580b8
I20260808 21:01:47.685683 26986 tablet_service.cc:1514] Processing DeleteTablet for tablet 8563502ee60540c69717c771f12580b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:47 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:37992
I20260808 21:01:47.685702 27433 tablet_service.cc:1514] Processing DeleteTablet for tablet 8563502ee60540c69717c771f12580b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:47 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:42030
I20260808 21:01:47.685783 27617 tablet_replica.cc:330] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: stopping tablet replica
I20260808 21:01:47.685830 27617 raft_consensus.cc:2229] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:47.685834 27615 tablet_replica.cc:330] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: stopping tablet replica
I20260808 21:01:47.685863 27617 raft_consensus.cc:2258] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:47.685904 27615 raft_consensus.cc:2229] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:47.686004 27615 raft_consensus.cc:2258] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:47.686086 27215 tablet_service.cc:1514] Processing DeleteTablet for tablet 8563502ee60540c69717c771f12580b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:47 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:58788
I20260808 21:01:47.686184 27616 tablet_replica.cc:330] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: stopping tablet replica
I20260808 21:01:47.686261 27616 raft_consensus.cc:2229] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:47.686306 27616 raft_consensus.cc:2258] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:47.686363 27615 ts_tablet_manager.cc:1905] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:47.686594 27616 ts_tablet_manager.cc:1905] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:47.688233 27617 ts_tablet_manager.cc:1905] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:47.689379 27617 ts_tablet_manager.cc:1918] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:47.689419 27617 log.cc:1196] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/8563502ee60540c69717c771f12580b8
I20260808 21:01:47.689580 27617 ts_tablet_manager.cc:1939] T 8563502ee60540c69717c771f12580b8 P bebb0574246d469f9b9f03990816ab8b: Deleting consensus metadata
I20260808 21:01:47.689873 26743 catalog_manager.cc:4841] TS bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673): tablet 8563502ee60540c69717c771f12580b8 (table test-table [id=939ba74b99c94d80b49a1e4e79d36c6f]) successfully deleted
I20260808 21:01:47.689965 27616 ts_tablet_manager.cc:1918] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:47.690023 27616 log.cc:1196] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/8563502ee60540c69717c771f12580b8
I20260808 21:01:47.690186 27616 ts_tablet_manager.cc:1939] T 8563502ee60540c69717c771f12580b8 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting consensus metadata
I20260808 21:01:47.690462 26741 catalog_manager.cc:4841] TS a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707): tablet 8563502ee60540c69717c771f12580b8 (table test-table [id=939ba74b99c94d80b49a1e4e79d36c6f]) successfully deleted
I20260808 21:01:47.691341 27615 ts_tablet_manager.cc:1918] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:47.691409 27615 log.cc:1196] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/8563502ee60540c69717c771f12580b8
I20260808 21:01:47.691636 27615 ts_tablet_manager.cc:1939] T 8563502ee60540c69717c771f12580b8 P 416307a9815648cf857d8366dd1a42e5: Deleting consensus metadata
I20260808 21:01:47.691998 26739 catalog_manager.cc:4841] TS 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853): tablet 8563502ee60540c69717c771f12580b8 (table test-table [id=939ba74b99c94d80b49a1e4e79d36c6f]) successfully deleted
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 21:01:47.718601 26867 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:47.712547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40552 (local address 127.14.146.254:43411)
0808 21:01:47.712622 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.712625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.712762 (+ 137us) server_negotiation.cc:407] Connection header received
0808 21:01:47.712833 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.712834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.712843 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.712893 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:47.713615 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.714109 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.715169 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.715350 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.715395 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.718525 (+ 3130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40552: BlockingRecv error: recv got EOF from 127.0.0.1:40552 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 21:01:47 dist-test-slave-t3q3 krb5kdc[26699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM
I20260808 21:01:47.727063 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:47.719645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40568 (local address 127.14.146.254:43411)
0808 21:01:47.719705 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:47.719708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:47.719751 (+ 43us) server_negotiation.cc:407] Connection header received
0808 21:01:47.719832 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:47.719833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:47.719841 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:47.719892 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:47.720436 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.720977 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.721715 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:47.721907 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:47.721979 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:47.724440 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:47.724442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:47.724442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:47.724451 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:47.725854 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.726250 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.726251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.726251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.726309 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:47.726516 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:47.726517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:47.726517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:47.726633 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:47.726741 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:47.726873 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 21:01:47.726956 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 21:01:47.728785 26767 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:47.728972 26767 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:47.730401 26986 tablet_service.cc:1467] Processing CreateTablet for tablet 10788aac3acc4cb8849168ecf2d092b0 (DEFAULT_TABLE table=test-table [id=a7ceb0a0ee154b768cb1a86a2d934f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.730424 27433 tablet_service.cc:1467] Processing CreateTablet for tablet 10788aac3acc4cb8849168ecf2d092b0 (DEFAULT_TABLE table=test-table [id=a7ceb0a0ee154b768cb1a86a2d934f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.730558 26986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10788aac3acc4cb8849168ecf2d092b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.730581 27433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10788aac3acc4cb8849168ecf2d092b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.731549 27579 tablet_bootstrap.cc:492] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: Bootstrap starting.
I20260808 21:01:47.731864 27579 tablet_bootstrap.cc:654] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.732173 27580 tablet_bootstrap.cc:492] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: Bootstrap starting.
I20260808 21:01:47.732424 27579 tablet_bootstrap.cc:492] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: No bootstrap required, opened a new log
I20260808 21:01:47.732486 27579 ts_tablet_manager.cc:1397] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:47.732605 27580 tablet_bootstrap.cc:654] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.732601 27579 raft_consensus.cc:348] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.732702 27579 raft_consensus.cc:374] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.732733 27579 raft_consensus.cc:729] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416307a9815648cf857d8366dd1a42e5, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.732777 27579 consensus_queue.cc:260] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.732865 27579 ts_tablet_manager.cc:1428] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:47.732014 27215 tablet_service.cc:1467] Processing CreateTablet for tablet 10788aac3acc4cb8849168ecf2d092b0 (DEFAULT_TABLE table=test-table [id=a7ceb0a0ee154b768cb1a86a2d934f29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:47.733227 27215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10788aac3acc4cb8849168ecf2d092b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:47.734601 27578 tablet_bootstrap.cc:492] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: Bootstrap starting.
I20260808 21:01:47.734930 27578 tablet_bootstrap.cc:654] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:47.735558 27580 tablet_bootstrap.cc:492] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: No bootstrap required, opened a new log
I20260808 21:01:47.735623 27580 ts_tablet_manager.cc:1397] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 21:01:47.735651 27578 tablet_bootstrap.cc:492] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: No bootstrap required, opened a new log
I20260808 21:01:47.735707 27578 ts_tablet_manager.cc:1397] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:47.735810 27580 raft_consensus.cc:348] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.735841 27578 raft_consensus.cc:348] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.735901 27580 raft_consensus.cc:374] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.735906 27578 raft_consensus.cc:374] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:47.735932 27578 raft_consensus.cc:729] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4a0408d9e50497dac8dbe18bf5cb822, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.735932 27580 raft_consensus.cc:729] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebb0574246d469f9b9f03990816ab8b, State: Initialized, Role: FOLLOWER
I20260808 21:01:47.735977 27580 consensus_queue.cc:260] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.735978 27578 consensus_queue.cc:260] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:47.736099 27578 ts_tablet_manager.cc:1428] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:47.736423 27580 ts_tablet_manager.cc:1428] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:48.142218 27589 raft_consensus.cc:482] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:48.142318 27589 raft_consensus.cc:504] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.142751 27589 leader_election.cc:288] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707), 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853)
I20260808 21:01:48.146164 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.143011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:40253 (local address 127.14.146.195:43853)
0808 21:01:48.143069 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:48.143072 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:48.143197 (+ 125us) server_negotiation.cc:407] Connection header received
0808 21:01:48.143243 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:48.143245 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:48.143254 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:48.143335 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:48.143493 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.144049 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.145192 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.145772 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.145847 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.145858 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:48.146051 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 21:01:48.146094 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 21:01:48.146164 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.142929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43853 (local address 127.14.146.193:40253)
0808 21:01:48.143084 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:48.143095 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:48.143185 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:48.143341 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:48.143342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:48.143344 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:48.143429 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:48.143431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.144139 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.144140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:48.145062 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:48.145065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.145846 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.145847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:48.145920 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.145925 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:01:48.146020 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 21:01:48.146066 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
I20260808 21:01:48.146358 27682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.142943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:37707 (local address 127.14.146.193:36629)
0808 21:01:48.143204 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:48.143216 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:48.143302 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:48.143475 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:48.143475 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:48.143477 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:01:48.143545 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:48.143546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.144347 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.144348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:48.145222 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:48.145225 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.145964 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.145965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:48.146042 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.146045 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:01:48.146095 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 21:01:48.146126 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":74,"threads_started":1}
I20260808 21:01:48.146376 27683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.143085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:36629 (local address 127.14.146.194:37707)
0808 21:01:48.143212 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:48.143214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:48.143283 (+ 69us) server_negotiation.cc:407] Connection header received
0808 21:01:48.143370 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:48.143371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:48.143381 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:48.143471 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:01:48.143636 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.144265 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.145309 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.145870 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.145944 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.145953 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:48.146102 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 21:01:48.146145 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
I20260808 21:01:48.146413 27460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10788aac3acc4cb8849168ecf2d092b0" candidate_uuid: "bebb0574246d469f9b9f03990816ab8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416307a9815648cf857d8366dd1a42e5" is_pre_election: true
I20260808 21:01:48.146507 27460 raft_consensus.cc:2454] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bebb0574246d469f9b9f03990816ab8b in term 0.
I20260808 21:01:48.146678 26907 leader_election.cc:302] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416307a9815648cf857d8366dd1a42e5, bebb0574246d469f9b9f03990816ab8b; no voters:
I20260808 21:01:48.146735 27244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10788aac3acc4cb8849168ecf2d092b0" candidate_uuid: "bebb0574246d469f9b9f03990816ab8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" is_pre_election: true
I20260808 21:01:48.146833 27244 raft_consensus.cc:2454] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bebb0574246d469f9b9f03990816ab8b in term 0.
I20260808 21:01:48.147135 27589 raft_consensus.cc:2781] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:48.147178 27589 raft_consensus.cc:482] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:48.147193 27589 raft_consensus.cc:3037] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:48.147903 27589 raft_consensus.cc:504] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.148047 27589 leader_election.cc:288] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [CANDIDATE]: Term 1 election: Requested vote from peers a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707), 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853)
I20260808 21:01:48.148224 27244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10788aac3acc4cb8849168ecf2d092b0" candidate_uuid: "bebb0574246d469f9b9f03990816ab8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4a0408d9e50497dac8dbe18bf5cb822"
I20260808 21:01:48.148315 27244 raft_consensus.cc:3037] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:48.148332 27460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10788aac3acc4cb8849168ecf2d092b0" candidate_uuid: "bebb0574246d469f9b9f03990816ab8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416307a9815648cf857d8366dd1a42e5"
I20260808 21:01:48.148419 27460 raft_consensus.cc:3037] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:48.148979 27244 raft_consensus.cc:2454] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bebb0574246d469f9b9f03990816ab8b in term 1.
I20260808 21:01:48.149099 27460 raft_consensus.cc:2454] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bebb0574246d469f9b9f03990816ab8b in term 1.
I20260808 21:01:48.149163 26908 leader_election.cc:302] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4a0408d9e50497dac8dbe18bf5cb822, bebb0574246d469f9b9f03990816ab8b; no voters:
I20260808 21:01:48.149257 27589 raft_consensus.cc:2781] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:48.149394 27589 raft_consensus.cc:686] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 1 LEADER]: Becoming Leader. State: Replica: bebb0574246d469f9b9f03990816ab8b, State: Running, Role: LEADER
I20260808 21:01:48.149508 27589 consensus_queue.cc:237] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.150275 26770 catalog_manager.cc:5495] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b reported cstate change: term changed from 0 to 1, leader changed from <none> to bebb0574246d469f9b9f03990816ab8b (127.14.146.193). New cstate: current_term: 1 leader_uuid: "bebb0574246d469f9b9f03990816ab8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:48.178222 27693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.175681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37998 (local address 127.14.146.193:44673)
0808 21:01:48.175854 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:48.175856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:48.175863 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:01:48.175903 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:48.175903 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:48.175922 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:48.175995 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:48.176179 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.176688 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.177427 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.177625 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.177680 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.177834 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:48.177947 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:48.178004 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:48.178041 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 21:01:48.178058 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":105,"threads_started":1}
I20260808 21:01:48.179303 27244 raft_consensus.cc:1261] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Refusing update from remote peer bebb0574246d469f9b9f03990816ab8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:48.179315 27460 raft_consensus.cc:1261] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Refusing update from remote peer bebb0574246d469f9b9f03990816ab8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:48.179569 27589 consensus_queue.cc:1035] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:48.179764 27684 consensus_queue.cc:1035] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:48.182928 26767 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:48.183027 26767 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:48.183667 26767 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: Sending DeleteTablet for 3 replicas of tablet 10788aac3acc4cb8849168ecf2d092b0
I20260808 21:01:48.183899 26986 tablet_service.cc:1514] Processing DeleteTablet for tablet 10788aac3acc4cb8849168ecf2d092b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:48 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:37992
I20260808 21:01:48.183929 27433 tablet_service.cc:1514] Processing DeleteTablet for tablet 10788aac3acc4cb8849168ecf2d092b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:48 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:42030
I20260808 21:01:48.183993 27215 tablet_service.cc:1514] Processing DeleteTablet for tablet 10788aac3acc4cb8849168ecf2d092b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:48 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:58788
I20260808 21:01:48.184021 27615 tablet_replica.cc:330] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: stopping tablet replica
I20260808 21:01:48.184099 27615 raft_consensus.cc:2229] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:48.184100 27617 tablet_replica.cc:330] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: stopping tablet replica
I20260808 21:01:48.184151 27615 raft_consensus.cc:2258] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:48.184152 27617 raft_consensus.cc:2229] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:48.184238 27617 raft_consensus.cc:2258] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:48.184324 27616 tablet_replica.cc:330] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: stopping tablet replica
I20260808 21:01:48.184391 27616 raft_consensus.cc:2229] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:48.184427 27616 raft_consensus.cc:2258] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:48.184659 26767 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:01:48.184827 26767 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:01:48.184835 27616 ts_tablet_manager.cc:1905] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:48.185298 27615 ts_tablet_manager.cc:1905] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:48.186149 27433 tablet_service.cc:1467] Processing CreateTablet for tablet eeaf24f5e93041169e7b92c88a53ae20 (DEFAULT_TABLE table=test-table [id=98fb3532da6f41a488c754c0e8acdb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:48.186264 27433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeaf24f5e93041169e7b92c88a53ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:48.186408 27616 ts_tablet_manager.cc:1918] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:48.186462 27616 log.cc:1196] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/10788aac3acc4cb8849168ecf2d092b0
I20260808 21:01:48.186687 27616 ts_tablet_manager.cc:1939] T 10788aac3acc4cb8849168ecf2d092b0 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting consensus metadata
I20260808 21:01:48.186959 27615 ts_tablet_manager.cc:1918] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:48.187009 27615 log.cc:1196] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/10788aac3acc4cb8849168ecf2d092b0
I20260808 21:01:48.187081 27617 ts_tablet_manager.cc:1905] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:48.187216 27615 ts_tablet_manager.cc:1939] T 10788aac3acc4cb8849168ecf2d092b0 P 416307a9815648cf857d8366dd1a42e5: Deleting consensus metadata
I20260808 21:01:48.187506 27579 tablet_bootstrap.cc:492] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: Bootstrap starting.
I20260808 21:01:48.187613 26739 catalog_manager.cc:4841] TS 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853): tablet 10788aac3acc4cb8849168ecf2d092b0 (table test-table [id=a7ceb0a0ee154b768cb1a86a2d934f29]) successfully deleted
I20260808 21:01:48.187747 26741 catalog_manager.cc:4841] TS a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707): tablet 10788aac3acc4cb8849168ecf2d092b0 (table test-table [id=a7ceb0a0ee154b768cb1a86a2d934f29]) successfully deleted
I20260808 21:01:48.187840 27579 tablet_bootstrap.cc:654] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:48.188522 27579 tablet_bootstrap.cc:492] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: No bootstrap required, opened a new log
I20260808 21:01:48.188580 27617 ts_tablet_manager.cc:1918] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:01:48.188589 27579 ts_tablet_manager.cc:1397] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:48.188649 27617 log.cc:1196] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/10788aac3acc4cb8849168ecf2d092b0
I20260808 21:01:48.188719 27579 raft_consensus.cc:348] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.188850 27579 raft_consensus.cc:374] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:48.188869 27617 ts_tablet_manager.cc:1939] T 10788aac3acc4cb8849168ecf2d092b0 P bebb0574246d469f9b9f03990816ab8b: Deleting consensus metadata
I20260808 21:01:48.188881 27579 raft_consensus.cc:729] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 416307a9815648cf857d8366dd1a42e5, State: Initialized, Role: FOLLOWER
I20260808 21:01:48.188930 27579 consensus_queue.cc:260] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.189023 27579 ts_tablet_manager.cc:1428] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:48.189226 26986 tablet_service.cc:1467] Processing CreateTablet for tablet eeaf24f5e93041169e7b92c88a53ae20 (DEFAULT_TABLE table=test-table [id=98fb3532da6f41a488c754c0e8acdb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:48.189358 26986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeaf24f5e93041169e7b92c88a53ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:48.189347 27215 tablet_service.cc:1467] Processing CreateTablet for tablet eeaf24f5e93041169e7b92c88a53ae20 (DEFAULT_TABLE table=test-table [id=98fb3532da6f41a488c754c0e8acdb89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:01:48.189452 27215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeaf24f5e93041169e7b92c88a53ae20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:48.190557 27580 tablet_bootstrap.cc:492] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: Bootstrap starting.
I20260808 21:01:48.190637 27578 tablet_bootstrap.cc:492] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: Bootstrap starting.
I20260808 21:01:48.190923 27578 tablet_bootstrap.cc:654] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:48.191005 27580 tablet_bootstrap.cc:654] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:48.191274 26743 catalog_manager.cc:4841] TS bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673): tablet 10788aac3acc4cb8849168ecf2d092b0 (table test-table [id=a7ceb0a0ee154b768cb1a86a2d934f29]) successfully deleted
I20260808 21:01:48.191511 27578 tablet_bootstrap.cc:492] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: No bootstrap required, opened a new log
I20260808 21:01:48.191566 27578 ts_tablet_manager.cc:1397] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:48.191658 27578 raft_consensus.cc:348] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.191730 27578 raft_consensus.cc:374] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:48.191751 27578 raft_consensus.cc:729] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4a0408d9e50497dac8dbe18bf5cb822, State: Initialized, Role: FOLLOWER
I20260808 21:01:48.191793 27578 consensus_queue.cc:260] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.191884 27578 ts_tablet_manager.cc:1428] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:48.192487 27580 tablet_bootstrap.cc:492] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: No bootstrap required, opened a new log
I20260808 21:01:48.192552 27580 ts_tablet_manager.cc:1397] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:01:48.192703 27580 raft_consensus.cc:348] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.192797 27580 raft_consensus.cc:374] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:48.192821 27580 raft_consensus.cc:729] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bebb0574246d469f9b9f03990816ab8b, State: Initialized, Role: FOLLOWER
I20260808 21:01:48.192871 27580 consensus_queue.cc:260] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.192976 27580 ts_tablet_manager.cc:1428] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:48.555012 27610 raft_consensus.cc:482] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:01:48.555158 27610 raft_consensus.cc:504] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.555383 27610 leader_election.cc:288] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673), 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853)
I20260808 21:01:48.555697 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeaf24f5e93041169e7b92c88a53ae20" candidate_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebb0574246d469f9b9f03990816ab8b" is_pre_election: true
I20260808 21:01:48.555699 27460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeaf24f5e93041169e7b92c88a53ae20" candidate_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416307a9815648cf857d8366dd1a42e5" is_pre_election: true
I20260808 21:01:48.555814 26996 raft_consensus.cc:2454] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4a0408d9e50497dac8dbe18bf5cb822 in term 0.
I20260808 21:01:48.555811 27460 raft_consensus.cc:2454] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4a0408d9e50497dac8dbe18bf5cb822 in term 0.
I20260808 21:01:48.555987 27135 leader_election.cc:302] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416307a9815648cf857d8366dd1a42e5, a4a0408d9e50497dac8dbe18bf5cb822; no voters:
I20260808 21:01:48.556129 27610 raft_consensus.cc:2781] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:01:48.556183 27610 raft_consensus.cc:482] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:01:48.556200 27610 raft_consensus.cc:3037] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:48.556921 27610 raft_consensus.cc:504] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.557066 27610 leader_election.cc:288] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [CANDIDATE]: Term 1 election: Requested vote from peers bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673), 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853)
I20260808 21:01:48.557217 26996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeaf24f5e93041169e7b92c88a53ae20" candidate_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bebb0574246d469f9b9f03990816ab8b"
I20260808 21:01:48.557294 26996 raft_consensus.cc:3037] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:48.557266 27460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeaf24f5e93041169e7b92c88a53ae20" candidate_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "416307a9815648cf857d8366dd1a42e5"
I20260808 21:01:48.557348 27460 raft_consensus.cc:3037] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:48.558002 27460 raft_consensus.cc:2454] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4a0408d9e50497dac8dbe18bf5cb822 in term 1.
I20260808 21:01:48.558020 26996 raft_consensus.cc:2454] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4a0408d9e50497dac8dbe18bf5cb822 in term 1.
I20260808 21:01:48.558193 27135 leader_election.cc:302] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 416307a9815648cf857d8366dd1a42e5, a4a0408d9e50497dac8dbe18bf5cb822; no voters:
I20260808 21:01:48.558310 27610 raft_consensus.cc:2781] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:48.558444 27610 raft_consensus.cc:686] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 LEADER]: Becoming Leader. State: Replica: a4a0408d9e50497dac8dbe18bf5cb822, State: Running, Role: LEADER
I20260808 21:01:48.558537 27610 consensus_queue.cc:237] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } }
I20260808 21:01:48.559159 26767 catalog_manager.cc:5495] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4a0408d9e50497dac8dbe18bf5cb822" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 37707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 } health_report { overall_health: UNKNOWN } } }
I20260808 21:01:48.635871 27683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.633922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58820 (local address 127.14.146.194:37707)
0808 21:01:48.633979 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:48.633981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:48.633990 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:01:48.634012 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:48.634013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:48.634035 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:48.634077 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:48.634170 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.634637 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.635349 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.635543 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.635597 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.635709 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:48.635734 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:48.635766 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:48.635798 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 21:01:48.635816 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 21:01:48.640589 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.638180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:51947 (local address 127.14.146.195:43853)
0808 21:01:48.638255 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:48.638257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:48.638371 (+ 114us) server_negotiation.cc:407] Connection header received
0808 21:01:48.638441 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:48.638442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:48.638452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:48.638524 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:48.638625 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.639083 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.639854 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.640046 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.640147 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.640332 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:48.640370 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:48.640429 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:48.640497 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 21:01:48.640519 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 21:01:48.640606 27717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.638125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43853 (local address 127.14.146.194:51947)
0808 21:01:48.638293 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:48.638303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:48.638388 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:48.638526 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:48.638527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:48.638529 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:48.638572 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:48.638573 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.639173 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.639174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:48.639764 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:48.639766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.640169 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.640170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:48.640229 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.640247 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:48.640444 (+ 197us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:48.640446 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:48.640484 (+ 38us) client_negotiation.cc:240] Negotiation successful
0808 21:01:48.640533 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260808 21:01:48.642450 26996 raft_consensus.cc:1261] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Refusing update from remote peer a4a0408d9e50497dac8dbe18bf5cb822: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:48.642478 27460 raft_consensus.cc:1261] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Refusing update from remote peer a4a0408d9e50497dac8dbe18bf5cb822: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:01:48.642668 27610 consensus_queue.cc:1035] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bebb0574246d469f9b9f03990816ab8b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:48.642807 27610 consensus_queue.cc:1035] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [LEADER]: Connected to new peer: Peer: permanent_uuid: "416307a9815648cf857d8366dd1a42e5" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:01:48.649973 27683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.647396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:56007 (local address 127.14.146.194:37707)
0808 21:01:48.647464 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:48.647466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:48.647577 (+ 111us) server_negotiation.cc:407] Connection header received
0808 21:01:48.647642 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:48.647643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:48.647656 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:48.647710 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:01:48.647851 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.648427 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.649164 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.649472 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.649555 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.649729 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:01:48.649761 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:01:48.649811 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:48.649880 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 21:01:48.649904 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 21:01:48.650008 27725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:48.647332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:37707 (local address 127.14.146.195:56007)
0808 21:01:48.647498 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:48.647513 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:48.647593 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:48.647733 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:48.647734 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:48.647736 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 21:01:48.647787 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:48.647788 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.648503 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.648504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:48.649049 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:48.649051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:48.649553 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:48.649554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:48.649618 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:48.649623 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 21:01:48.649833 (+ 210us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 21:01:48.649835 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:01:48.649880 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 21:01:48.649927 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":116,"threads_started":1}
I20260808 21:01:48.655941 26767 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:48.656046 26767 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:01:48.656703 26767 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29928f1b76c34e1480df51042f225347: Sending DeleteTablet for 3 replicas of tablet eeaf24f5e93041169e7b92c88a53ae20
I20260808 21:01:48.656945 26986 tablet_service.cc:1514] Processing DeleteTablet for tablet eeaf24f5e93041169e7b92c88a53ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:48 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:37992
I20260808 21:01:48.657011 27433 tablet_service.cc:1514] Processing DeleteTablet for tablet eeaf24f5e93041169e7b92c88a53ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:48 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:42030
I20260808 21:01:48.657076 27617 tablet_replica.cc:330] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: stopping tablet replica
I20260808 21:01:48.657117 27615 tablet_replica.cc:330] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: stopping tablet replica
I20260808 21:01:48.657146 27617 raft_consensus.cc:2229] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:48.657171 27615 raft_consensus.cc:2229] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:01:48.657192 27617 raft_consensus.cc:2258] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:48.657220 27615 raft_consensus.cc:2258] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:48.657356 27215 tablet_service.cc:1514] Processing DeleteTablet for tablet eeaf24f5e93041169e7b92c88a53ae20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:01:48 UTC) from {username='oryx', principal='oryx/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:58788
I20260808 21:01:48.657472 27616 tablet_replica.cc:330] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: stopping tablet replica
I20260808 21:01:48.657485 27617 ts_tablet_manager.cc:1905] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:48.657528 27616 raft_consensus.cc:2229] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:01:48.657594 27616 raft_consensus.cc:2258] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:01:48.657871 27616 ts_tablet_manager.cc:1905] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:48.657931 27615 ts_tablet_manager.cc:1905] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:01:48.659155 27617 ts_tablet_manager.cc:1918] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:48.659225 27617 log.cc:1196] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/eeaf24f5e93041169e7b92c88a53ae20
I20260808 21:01:48.659464 27617 ts_tablet_manager.cc:1939] T eeaf24f5e93041169e7b92c88a53ae20 P bebb0574246d469f9b9f03990816ab8b: Deleting consensus metadata
I20260808 21:01:48.659471 27616 ts_tablet_manager.cc:1918] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:48.659528 27616 log.cc:1196] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/eeaf24f5e93041169e7b92c88a53ae20
I20260808 21:01:48.659770 27616 ts_tablet_manager.cc:1939] T eeaf24f5e93041169e7b92c88a53ae20 P a4a0408d9e50497dac8dbe18bf5cb822: Deleting consensus metadata
I20260808 21:01:48.659868 27615 ts_tablet_manager.cc:1918] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 21:01:48.659868 26743 catalog_manager.cc:4841] TS bebb0574246d469f9b9f03990816ab8b (127.14.146.193:44673): tablet eeaf24f5e93041169e7b92c88a53ae20 (table test-table [id=98fb3532da6f41a488c754c0e8acdb89]) successfully deleted
I20260808 21:01:48.659919 27615 log.cc:1196] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/eeaf24f5e93041169e7b92c88a53ae20
I20260808 21:01:48.660115 26741 catalog_manager.cc:4841] TS a4a0408d9e50497dac8dbe18bf5cb822 (127.14.146.194:37707): tablet eeaf24f5e93041169e7b92c88a53ae20 (table test-table [id=98fb3532da6f41a488c754c0e8acdb89]) successfully deleted
I20260808 21:01:48.660181 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 26884
I20260808 21:01:48.670037 27615 ts_tablet_manager.cc:1939] T eeaf24f5e93041169e7b92c88a53ae20 P 416307a9815648cf857d8366dd1a42e5: Deleting consensus metadata
I20260808 21:01:48.675031 26739 catalog_manager.cc:4841] TS 416307a9815648cf857d8366dd1a42e5 (127.14.146.195:43853): tablet eeaf24f5e93041169e7b92c88a53ae20 (table test-table [id=98fb3532da6f41a488c754c0e8acdb89]) successfully deleted
I20260808 21:01:48.680887 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 27112
I20260808 21:01:48.695185 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 27332
I20260808 21:01:48.709029 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 26716
2026-08-08T21:01:48Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3689 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:48 dist-test-slave-t3q3 krb5kdc[27730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:48 dist-test-slave-t3q3 krb5kdc[27730](info): set up 2 sockets
Aug 08 21:01:48 dist-test-slave-t3q3 krb5kdc[27730](info): commencing operation
krb5kdc: starting...
W20260808 21:01:49.958952 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:50 dist-test-slave-t3q3 krb5kdc[27730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:50.082986 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:37885
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:37885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:50.169399 27755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:50.169615 27755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:50.169637 27755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:50.170744 27755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:50.170780 27755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:50.170794 27755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:50.170807 27755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:50.170819 27755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:50.172289 27755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:37885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:37885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:50.172502 27755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:50.172683 27755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:50.177809 27770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:50.177819 27765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:50.177809 27764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:50.178036 27755 server_base.cc:1034] running on GCE node
I20260808 21:01:50.178396 27755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:50.178743 27755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:50.179920 27755 hybrid_clock.cc:648] HybridClock initialized: now 1786222910179896 us; error 43 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T21:01:50Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1472 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:01:50 dist-test-slave-t3q3 krb5kdc[27777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:01:50 dist-test-slave-t3q3 krb5kdc[27777](info): set up 2 sockets
Aug 08 21:01:50 dist-test-slave-t3q3 krb5kdc[27777](info): commencing operation
krb5kdc: starting...
W20260808 21:01:51.440865 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:01:51 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:01:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:01:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:01:51.570297 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45929
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45929
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:51.655494 27796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:51.655791 27796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:51.655843 27796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:51.657100 27796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:51.657177 27796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:51.657202 27796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:51.657222 27796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:51.657251 27796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:51.658749 27796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45929
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:51.659039 27796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:51.659277 27796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:51.664585 27805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:51.664574 27804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:51.664574 27808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:51.664675 27796 server_base.cc:1034] running on GCE node
I20260808 21:01:51.665097 27796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:51.665419 27796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:51.666586 27796 hybrid_clock.cc:648] HybridClock initialized: now 1786222911666573 us; error 47 us; skew 500 ppm
Aug 08 21:01:51 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222911, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:51.669275 27796 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:51.669755 27796 webserver.cc:460] Webserver started at http://127.14.146.254:35985/ using document root <none> and password file <none>
I20260808 21:01:51.669962 27796 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:51.670003 27796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:51.670100 27796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:51.671129 27796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "af800e3f7854426d8e55af7a63f1f0bd"
format_stamp: "Formatted at 2026-08-08 21:01:51 on dist-test-slave-t3q3"
server_key: "97cbc0deebdf4f766df95651951e1b75"
server_key_iv: "5d60d57c3485bd77e70b5b3dba652198"
server_key_version: "encryptionkey@0"
I20260808 21:01:51.671451 27796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "af800e3f7854426d8e55af7a63f1f0bd"
format_stamp: "Formatted at 2026-08-08 21:01:51 on dist-test-slave-t3q3"
server_key: "97cbc0deebdf4f766df95651951e1b75"
server_key_iv: "5d60d57c3485bd77e70b5b3dba652198"
server_key_version: "encryptionkey@0"
I20260808 21:01:51.672868 27796 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:01:51.673605 27820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:51.673807 27796 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:51.673902 27796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "af800e3f7854426d8e55af7a63f1f0bd"
format_stamp: "Formatted at 2026-08-08 21:01:51 on dist-test-slave-t3q3"
server_key: "97cbc0deebdf4f766df95651951e1b75"
server_key_iv: "5d60d57c3485bd77e70b5b3dba652198"
server_key_version: "encryptionkey@0"
I20260808 21:01:51.673959 27796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:51.686389 27796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:51.688380 27796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:51.688489 27796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:51.692284 27796 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:45929
I20260808 21:01:51.692343 27903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:45929 every 8 connection(s)
I20260808 21:01:51.692668 27796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:51.693621 27904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:01:51.695931 27904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Bootstrap starting.
I20260808 21:01:51.696548 27904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Neither blocks nor log segments found. Creating new log.
I20260808 21:01:51.696771 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 27796
I20260808 21:01:51.696887 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:01:51.696902 27904 log.cc:824] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:51.697104 14923 external_mini_cluster.cc:1428] Setting key bde1eaf4c1f5655c47d37c7bbf34315f
I20260808 21:01:51.697817 27904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: No bootstrap required, opened a new log
I20260808 21:01:51.700563 27904 raft_consensus.cc:348] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } }
I20260808 21:01:51.700735 27904 raft_consensus.cc:374] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:01:51.700791 27904 raft_consensus.cc:729] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af800e3f7854426d8e55af7a63f1f0bd, State: Initialized, Role: FOLLOWER
I20260808 21:01:51.700923 27904 consensus_queue.cc:260] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } }
I20260808 21:01:51.701027 27904 raft_consensus.cc:388] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:51.701073 27904 raft_consensus.cc:482] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:51.701122 27904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:01:51.701745 27904 raft_consensus.cc:504] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } }
I20260808 21:01:51.701856 27904 leader_election.cc:302] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af800e3f7854426d8e55af7a63f1f0bd; no voters:
I20260808 21:01:51.702024 27904 leader_election.cc:288] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:01:51.702090 27913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:01:51.702286 27904 sys_catalog.cc:564] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:51.702301 27913 raft_consensus.cc:686] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 1 LEADER]: Becoming Leader. State: Replica: af800e3f7854426d8e55af7a63f1f0bd, State: Running, Role: LEADER
I20260808 21:01:51.702502 27913 consensus_queue.cc:237] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } }
I20260808 21:01:51.702955 27917 sys_catalog.cc:455] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader af800e3f7854426d8e55af7a63f1f0bd. Latest consensus state: current_term: 1 leader_uuid: "af800e3f7854426d8e55af7a63f1f0bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } } }
I20260808 21:01:51.703084 27917 sys_catalog.cc:458] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:51.702872 27915 sys_catalog.cc:455] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af800e3f7854426d8e55af7a63f1f0bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } } }
I20260808 21:01:51.703685 27915 sys_catalog.cc:458] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:51.703723 27929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:51.704308 27929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 21:01:51 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:51.706275 27929 catalog_manager.cc:1347] Generated new cluster ID: d1e47e73e831437a8105e0e1a4137a56
I20260808 21:01:51.706354 27929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:51.708712 27912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:51.697615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34386 (local address 127.14.146.254:45929)
0808 21:01:51.697818 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:51.697827 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:51.697863 (+ 36us) server_negotiation.cc:407] Connection header received
0808 21:01:51.698373 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:51.698382 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:51.698447 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:51.698603 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:51.699188 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:51.700662 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:51.701563 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:51.702214 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:51.702366 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:51.705213 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:51.705217 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:51.705217 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:51.705228 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:51.707116 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:51.707481 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:51.707484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:51.707484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:51.707574 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:51.707789 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:51.707790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:51.707790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:51.708024 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:51.708221 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:51.708359 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 21:01:51.708502 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260808 21:01:51.747750 27929 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:01:51.748395 27929 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:51.761932 27929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Generated new TSK 0
I20260808 21:01:51.762140 27929 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:01:51.794929 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45929
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:51.879477 27950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:51.879695 27950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:51.879720 27950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:51.881012 27950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:51.881060 27950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:51.881125 27950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:51.882577 27950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:51.882834 27950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:51.883073 27950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:51.888331 27958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:51.888327 27962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:51.888408 27957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:51.888523 27950 server_base.cc:1034] running on GCE node
I20260808 21:01:51.888741 27950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:51.888953 27950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:51.890120 27950 hybrid_clock.cc:648] HybridClock initialized: now 1786222911890097 us; error 29 us; skew 500 ppm
Aug 08 21:01:51 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222911, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:51.892920 27950 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:01:51.893477 27950 webserver.cc:460] Webserver started at http://127.14.146.193:38237/ using document root <none> and password file <none>
I20260808 21:01:51.893667 27950 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:51.893719 27950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:51.893812 27950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:51.894855 27950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "bb7a1f632ed649559243fc2ddf8d46a5"
format_stamp: "Formatted at 2026-08-08 21:01:51 on dist-test-slave-t3q3"
server_key: "b13f2660cc4f05a13ce679199ba2c484"
server_key_iv: "569bd8d461370553a5b6eaa330887029"
server_key_version: "encryptionkey@0"
I20260808 21:01:51.895167 27950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "bb7a1f632ed649559243fc2ddf8d46a5"
format_stamp: "Formatted at 2026-08-08 21:01:51 on dist-test-slave-t3q3"
server_key: "b13f2660cc4f05a13ce679199ba2c484"
server_key_iv: "569bd8d461370553a5b6eaa330887029"
server_key_version: "encryptionkey@0"
I20260808 21:01:51.896631 27950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:01:51.897339 27969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:51.897506 27950 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:01:51.897580 27950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "bb7a1f632ed649559243fc2ddf8d46a5"
format_stamp: "Formatted at 2026-08-08 21:01:51 on dist-test-slave-t3q3"
server_key: "b13f2660cc4f05a13ce679199ba2c484"
server_key_iv: "569bd8d461370553a5b6eaa330887029"
server_key_version: "encryptionkey@0"
I20260808 21:01:51.897634 27950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:51.915285 27950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:51.917294 27950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:51.917408 27950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:51.917595 27950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:51.917865 27950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:51.917894 27950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:51.917915 27950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:51.917929 27950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:51.923581 27950 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:42657
I20260808 21:01:51.923664 28144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:42657 every 8 connection(s)
I20260808 21:01:51.923995 27950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
Aug 08 21:01:51 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222911, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:51.930816 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 27950
I20260808 21:01:51.930940 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:01:51.931188 14923 external_mini_cluster.cc:1428] Setting key 9b150c4ae6652f8b16cc5333b188eeae
I20260808 21:01:51.933841 27912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:51.924835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:39297 (local address 127.14.146.254:45929)
0808 21:01:51.924913 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:51.924915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:51.925137 (+ 222us) server_negotiation.cc:407] Connection header received
0808 21:01:51.925602 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:51.925603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:51.925614 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:51.925669 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:51.926734 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:51.927247 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:51.928266 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:51.928464 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:51.928518 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:51.930699 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:51.930701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:51.930702 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:51.930711 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:51.932364 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:51.932816 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:51.932817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:51.932818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:51.932886 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:51.933156 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:51.933157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:51.933158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:51.933300 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:51.933382 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:51.933652 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 21:01:51.933744 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 21:01:51.934051 28148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:51.924806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:39297)
0808 21:01:51.924985 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:51.925051 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:51.925518 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:51.925815 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:51.925819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:51.926439 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:51.926646 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:51.926651 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:51.927338 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:51.927339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:51.928190 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:51.928192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:51.928543 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:51.928544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:51.928647 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:51.929195 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:51.929204 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:51.930589 (+ 1385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:51.932485 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:51.932492 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:51.932495 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:51.932735 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:51.932956 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:51.932957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:51.932957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:51.933078 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:51.933374 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:51.933381 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:51.933518 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 21:01:51.933630 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 21:01:51.933805 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260808 21:01:51.934619 28145 heartbeater.cc:347] Connected to a master server at 127.14.146.254:45929
I20260808 21:01:51.934741 28145 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:51.934962 28145 heartbeater.cc:511] Master 127.14.146.254:45929 requested a full tablet report, sending...
I20260808 21:01:51.935527 27845 ts_manager.cc:194] Registered new tserver with Master: bb7a1f632ed649559243fc2ddf8d46a5 (127.14.146.193:42657)
I20260808 21:01:51.936216 27845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:39297
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:01:51.956641 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45929
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:52.041322 28154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:52.041553 28154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:52.041577 28154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:52.042804 28154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:52.042855 28154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:52.042882 28154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:52.044415 28154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:52.044669 28154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:52.044942 28154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:52.050648 28164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.050676 28154 server_base.cc:1034] running on GCE node
W20260808 21:01:52.050683 28167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.050648 28165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.051080 28154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:52.051368 28154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:52.052541 28154 hybrid_clock.cc:648] HybridClock initialized: now 1786222912052534 us; error 38 us; skew 500 ppm
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222912, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:52.055171 28154 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:01:52.055619 28154 webserver.cc:460] Webserver started at http://127.14.146.194:45133/ using document root <none> and password file <none>
I20260808 21:01:52.055857 28154 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:52.055927 28154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:52.056137 28154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:52.057217 28154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "615dffb77c3d4b228f2f3b858a3457e3"
format_stamp: "Formatted at 2026-08-08 21:01:52 on dist-test-slave-t3q3"
server_key: "b68eab5ebd6367f0af53020a603e3358"
server_key_iv: "68c16279821459d881ce82c20f71c006"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.057605 28154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "615dffb77c3d4b228f2f3b858a3457e3"
format_stamp: "Formatted at 2026-08-08 21:01:52 on dist-test-slave-t3q3"
server_key: "b68eab5ebd6367f0af53020a603e3358"
server_key_iv: "68c16279821459d881ce82c20f71c006"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.058987 28154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:01:52.059736 28180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.059924 28154 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:52.060037 28154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "615dffb77c3d4b228f2f3b858a3457e3"
format_stamp: "Formatted at 2026-08-08 21:01:52 on dist-test-slave-t3q3"
server_key: "b68eab5ebd6367f0af53020a603e3358"
server_key_iv: "68c16279821459d881ce82c20f71c006"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.060181 28154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:52.088865 28154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:52.090837 28154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:52.091022 28154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:52.091285 28154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:52.091634 28154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:52.091693 28154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.091737 28154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:52.091760 28154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.097803 28154 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:43917
I20260808 21:01:52.097859 28349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:43917 every 8 connection(s)
I20260808 21:01:52.098207 28154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:52.102174 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 28154
I20260808 21:01:52.102321 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:01:52.102515 14923 external_mini_cluster.cc:1428] Setting key 9ca4817497494dda857928204a141972
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222912, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:52.108686 27912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.098944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:54537 (local address 127.14.146.254:45929)
0808 21:01:52.099008 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.099011 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.099231 (+ 220us) server_negotiation.cc:407] Connection header received
0808 21:01:52.099737 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.099738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.099749 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.099814 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.100957 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.101560 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.102924 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.103167 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.103237 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.105490 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:52.105491 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:52.105492 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:52.105500 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:52.107014 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:52.107528 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:52.107529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:52.107530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:52.107583 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:52.107922 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:52.107923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:52.107923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:52.108045 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:52.108179 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:52.108542 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 21:01:52.108622 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:01:52.108945 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.098916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:54537)
0808 21:01:52.099093 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.099135 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.099618 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.099869 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.099872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.100662 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.100865 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.100871 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.101654 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.101655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.102848 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.102851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.103258 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.103259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.103403 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.103947 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.103955 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.105388 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:52.107101 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:52.107108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:52.107111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:52.107436 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:52.107650 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:52.107651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:52.107651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:52.107821 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:52.108197 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:52.108205 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:52.108386 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 21:01:52.108514 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 21:01:52.108691 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":101,"threads_started":1}
I20260808 21:01:52.109501 28350 heartbeater.cc:347] Connected to a master server at 127.14.146.254:45929
I20260808 21:01:52.109608 28350 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:52.109817 28350 heartbeater.cc:511] Master 127.14.146.254:45929 requested a full tablet report, sending...
I20260808 21:01:52.110236 27845 ts_manager.cc:194] Registered new tserver with Master: 615dffb77c3d4b228f2f3b858a3457e3 (127.14.146.194:43917)
I20260808 21:01:52.110621 27845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:54537
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:01:52.129122 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45929
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:52.212478 28361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:52.212705 28361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:52.212743 28361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:52.213904 28361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:52.213971 28361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:52.214015 28361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:52.215473 28361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:45929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:52.215755 28361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:52.215986 28361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:52.221040 28368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.221064 28369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.221228 28361 server_base.cc:1034] running on GCE node
W20260808 21:01:52.221047 28373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.221549 28361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:52.221809 28361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:52.222937 28361 hybrid_clock.cc:648] HybridClock initialized: now 1786222912222918 us; error 40 us; skew 500 ppm
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222912, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:52.225591 28361 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:01:52.226060 28361 webserver.cc:460] Webserver started at http://127.14.146.195:39461/ using document root <none> and password file <none>
I20260808 21:01:52.226317 28361 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:52.226387 28361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:52.226537 28361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:01:52.227604 28361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "181d11f0829c47cfad4d47c3ec0fcff9"
format_stamp: "Formatted at 2026-08-08 21:01:52 on dist-test-slave-t3q3"
server_key: "69cf10f8f40d15f9b641a434d1a87402"
server_key_iv: "3e264788d4fd7da3f2ee175a6732900e"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.228001 28361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "181d11f0829c47cfad4d47c3ec0fcff9"
format_stamp: "Formatted at 2026-08-08 21:01:52 on dist-test-slave-t3q3"
server_key: "69cf10f8f40d15f9b641a434d1a87402"
server_key_iv: "3e264788d4fd7da3f2ee175a6732900e"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.229405 28361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:52.230140 28384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.230327 28361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.230437 28361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "181d11f0829c47cfad4d47c3ec0fcff9"
format_stamp: "Formatted at 2026-08-08 21:01:52 on dist-test-slave-t3q3"
server_key: "69cf10f8f40d15f9b641a434d1a87402"
server_key_iv: "3e264788d4fd7da3f2ee175a6732900e"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.230513 28361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:52.247730 28361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:52.250259 28361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:52.250433 28361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:52.250681 28361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:52.251024 28361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:52.251058 28361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.251081 28361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:52.251132 28361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.256950 28361 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:42063
I20260808 21:01:52.257035 28559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:42063 every 8 connection(s)
I20260808 21:01:52.257370 28361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222912, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:01:52.265080 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 28361
I20260808 21:01:52.265192 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:01:52.265396 14923 external_mini_cluster.cc:1428] Setting key 43e53ad2de273fd39c6b8e1efb825e28
I20260808 21:01:52.267514 27912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.258163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:42915 (local address 127.14.146.254:45929)
0808 21:01:52.258256 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.258259 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.258438 (+ 179us) server_negotiation.cc:407] Connection header received
0808 21:01:52.258996 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.258997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.259010 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.259085 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.260100 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.260628 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.261651 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.261970 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.262072 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.264502 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:52.264504 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:52.264504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:52.264512 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:52.266191 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:52.266634 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:52.266635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:52.266635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:52.266690 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:52.266941 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:52.266943 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:52.266943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:52.267076 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:52.267138 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:52.267382 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 21:01:52.267450 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 21:01:52.267664 28563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.258119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:42915)
0808 21:01:52.258300 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.258350 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.258879 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.259159 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.259164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.259774 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.259973 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.259978 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.260729 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.260731 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.261544 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.261546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.262149 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.262150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.262295 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.262827 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.262836 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.264366 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:01:52.266268 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:52.266273 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:52.266275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:52.266567 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:52.266756 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:01:52.266757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:01:52.266757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:01:52.266858 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:01:52.267139 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:01:52.267143 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:01:52.267268 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 21:01:52.267351 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 21:01:52.267472 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260808 21:01:52.268163 28560 heartbeater.cc:347] Connected to a master server at 127.14.146.254:45929
I20260808 21:01:52.268308 28560 heartbeater.cc:464] Registering TS with master...
I20260808 21:01:52.268507 28560 heartbeater.cc:511] Master 127.14.146.254:45929 requested a full tablet report, sending...
I20260808 21:01:52.268906 27845 ts_manager.cc:194] Registered new tserver with Master: 181d11f0829c47cfad4d47c3ec0fcff9 (127.14.146.195:42063)
I20260808 21:01:52.269269 27845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:42915
I20260808 21:01:52.277325 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab.
Entry for principal oryx/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab.
WARNING: no policy specified for oryx/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab.
Entry for principal oryx/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab.
WARNING: no policy specified for oryx/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab.
Entry for principal oryx/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab.
I20260808 21:01:52.348657 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 27950
I20260808 21:01:52.365387 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 28154
I20260808 21:01:52.383301 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 28361
I20260808 21:01:52.398066 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 27796
I20260808 21:01:52.409467 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45929
--webserver_interface=127.14.146.254
--webserver_port=35985
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45929
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:01:52.494036 28575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:52.494248 28575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:52.494271 28575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:52.495431 28575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:01:52.495478 28575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:52.495493 28575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:52.495532 28575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:01:52.495565 28575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:01:52.497130 28575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45929
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=35985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:52.497403 28575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:52.497648 28575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:52.502761 28581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.502756 28582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.502815 28584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.502990 28575 server_base.cc:1034] running on GCE node
I20260808 21:01:52.503252 28575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:52.503569 28575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:52.504727 28575 hybrid_clock.cc:648] HybridClock initialized: now 1786222912504717 us; error 41 us; skew 500 ppm
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222912, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:52.507275 28575 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:01:52.507712 28575 webserver.cc:460] Webserver started at http://127.14.146.254:35985/ using document root <none> and password file <none>
I20260808 21:01:52.507951 28575 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:52.508035 28575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:52.509445 28575 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:52.510136 28592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.510306 28575 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:52.510408 28575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "af800e3f7854426d8e55af7a63f1f0bd"
format_stamp: "Formatted at 2026-08-08 21:01:51 on dist-test-slave-t3q3"
server_key: "97cbc0deebdf4f766df95651951e1b75"
server_key_iv: "5d60d57c3485bd77e70b5b3dba652198"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.510766 28575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:52.518796 28575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:52.521066 28575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:52.521231 28575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:52.525424 28575 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:45929
I20260808 21:01:52.525466 28677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:45929 every 8 connection(s)
I20260808 21:01:52.525828 28575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:01:52.527242 28678 sys_catalog.cc:263] Verifying existing consensus state
I20260808 21:01:52.527930 28678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Bootstrap starting.
I20260808 21:01:52.535111 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 28575
I20260808 21:01:52.535545 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:42657
--local_ip_for_outbound_sockets=127.14.146.193
--tserver_master_addrs=127.14.146.254:45929
--webserver_port=38237
--webserver_interface=127.14.146.193
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.146.193
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:01:52.537866 28678 log.cc:824] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Log is configured to *not* fsync() on all Append() calls
I20260808 21:01:52.539731 28678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:01:52.540051 28678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Bootstrap complete.
I20260808 21:01:52.542500 28678 raft_consensus.cc:348] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } }
I20260808 21:01:52.542738 28678 raft_consensus.cc:729] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: af800e3f7854426d8e55af7a63f1f0bd, State: Initialized, Role: FOLLOWER
I20260808 21:01:52.542912 28678 consensus_queue.cc:260] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } }
I20260808 21:01:52.542985 28678 raft_consensus.cc:388] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:01:52.543054 28678 raft_consensus.cc:482] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:01:52.543105 28678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 1 FOLLOWER]: Advancing to term 2
I20260808 21:01:52.544260 28678 raft_consensus.cc:504] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } }
I20260808 21:01:52.544363 28678 leader_election.cc:302] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af800e3f7854426d8e55af7a63f1f0bd; no voters:
I20260808 21:01:52.544596 28678 leader_election.cc:288] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 21:01:52.544636 28684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 2 FOLLOWER]: Leader election won for term 2
I20260808 21:01:52.544780 28684 raft_consensus.cc:686] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [term 2 LEADER]: Becoming Leader. State: Replica: af800e3f7854426d8e55af7a63f1f0bd, State: Running, Role: LEADER
I20260808 21:01:52.544868 28684 consensus_queue.cc:237] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } }
I20260808 21:01:52.544898 28678 sys_catalog.cc:564] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:01:52.546810 28708 catalog_manager.cc:1259] Loaded cluster ID: d1e47e73e831437a8105e0e1a4137a56
I20260808 21:01:52.546859 28708 catalog_manager.cc:1552] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: loading cluster ID for follower catalog manager: success
I20260808 21:01:52.546897 28685 sys_catalog.cc:455] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader af800e3f7854426d8e55af7a63f1f0bd. Latest consensus state: current_term: 2 leader_uuid: "af800e3f7854426d8e55af7a63f1f0bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } } }
I20260808 21:01:52.546968 28685 sys_catalog.cc:458] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:52.546689 28688 sys_catalog.cc:455] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "af800e3f7854426d8e55af7a63f1f0bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af800e3f7854426d8e55af7a63f1f0bd" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45929 } } }
I20260808 21:01:52.547253 28688 sys_catalog.cc:458] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd [sys.catalog]: This master's current role is: LEADER
I20260808 21:01:52.548033 28708 catalog_manager.cc:1574] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: acquiring CA information for follower catalog manager: success
I20260808 21:01:52.548393 28708 catalog_manager.cc:1602] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:01:52.548480 28712 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:01:52.548631 28712 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:01:52.548707 28712 catalog_manager.cc:1259] Loaded cluster ID: d1e47e73e831437a8105e0e1a4137a56
I20260808 21:01:52.548739 28712 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:01:52.548918 28712 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:01:52.549014 28712 catalog_manager.cc:5879] T 00000000000000000000000000000000 P af800e3f7854426d8e55af7a63f1f0bd: Loaded TSK: 0
I20260808 21:01:52.549160 28712 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 21:01:52.624507 28682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:52.624755 28682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:52.624799 28682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:52.626006 28682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:52.626076 28682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:52.626124 28682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:01:52.627627 28682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.193.keytab
--principal=oryx/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:42657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=38237
--tserver_master_addrs=127.14.146.254:45929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:52.627905 28682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:52.628208 28682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:52.633615 28718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.633648 28682 server_base.cc:1034] running on GCE node
W20260808 21:01:52.633590 28720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.633744 28723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.634156 28682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:52.634490 28682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:52.635673 28682 hybrid_clock.cc:648] HybridClock initialized: now 1786222912635660 us; error 30 us; skew 500 ppm
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222912, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:52.638867 28682 init.cc:377] Logged in from keytab as oryx/127.14.146.193@KRBTEST.COM (short username oryx)
I20260808 21:01:52.639418 28682 webserver.cc:460] Webserver started at http://127.14.146.193:38237/ using document root <none> and password file <none>
I20260808 21:01:52.639709 28682 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:52.639806 28682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:52.641296 28682 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:01:52.641990 28731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.642174 28682 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:01:52.642272 28682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "bb7a1f632ed649559243fc2ddf8d46a5"
format_stamp: "Formatted at 2026-08-08 21:01:51 on dist-test-slave-t3q3"
server_key: "b13f2660cc4f05a13ce679199ba2c484"
server_key_iv: "569bd8d461370553a5b6eaa330887029"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.642645 28682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:52.667631 28682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:52.670301 28682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:52.670487 28682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:52.670796 28682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:52.671161 28682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:52.671218 28682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.671255 28682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:52.671283 28682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.678829 28682 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:42657
I20260808 21:01:52.678894 28904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:42657 every 8 connection(s)
I20260808 21:01:52.679312 28682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:01:52.682776 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 28682
I20260808 21:01:52.683104 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:43917
--local_ip_for_outbound_sockets=127.14.146.194
--tserver_master_addrs=127.14.146.254:45929
--webserver_port=45133
--webserver_interface=127.14.146.194
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.146.194
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:52.689309 28907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.680148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:47921)
0808 21:01:52.680330 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.680375 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.680859 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.681251 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.681254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.681845 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.682054 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.682058 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.683252 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.683253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.684612 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.684616 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.685524 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.685526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.685652 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.686412 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.686422 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.689147 (+ 2725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
W20260808 21:01:52.689553 28905 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:45929 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.146.254:45929: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
W20260808 21:01:52.689553 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.680206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:47921 (local address 127.14.146.254:45929)
0808 21:01:52.680395 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.680404 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.680459 (+ 55us) server_negotiation.cc:407] Connection header received
0808 21:01:52.681024 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.681029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.681070 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.681184 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.682158 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.683117 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.684726 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.685403 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.685526 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.689332 (+ 3806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:47921: BlockingRecv error: recv got EOF from 127.14.146.193:47921 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:52.694803 28907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.689783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:53281)
0808 21:01:52.689880 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.689890 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.689925 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.690210 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.690212 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.690328 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.690376 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.690377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.691343 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.691344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.691849 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.691851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.692393 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.692394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.692463 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.692947 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.692951 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.694758 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":81}
W20260808 21:01:52.694958 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.690002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:53281 (local address 127.14.146.254:45929)
0808 21:01:52.690067 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.690069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.690079 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:52.690106 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.690106 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.690122 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.690196 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.690456 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.691255 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.691935 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.692302 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.692384 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.694884 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:53281: BlockingRecv error: recv got EOF from 127.14.146.193:53281 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:52.700119 28910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.695051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:54449)
0808 21:01:52.695239 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.695252 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.695308 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.695455 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.695456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.695645 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.695706 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.695708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.696408 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.696409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.697310 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.697312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.697675 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.697676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.697748 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.698215 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.698221 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.699993 (+ 1772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":105,"threads_started":1}
W20260808 21:01:52.700191 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.695254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:54449 (local address 127.14.146.254:45929)
0808 21:01:52.695299 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.695300 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.695308 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:52.695372 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.695373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.695381 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.695428 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.695805 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.696333 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.697403 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.697583 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.697640 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.700135 (+ 2495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:54449: BlockingRecv error: recv got EOF from 127.14.146.193:54449 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 21:01:52.700326 28905 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 21:01:52.773700 28909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:52.773941 28909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:52.773967 28909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:52.775133 28909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:52.775177 28909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:52.775202 28909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:01:52.776683 28909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.194.keytab
--principal=oryx/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:43917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=45133
--tserver_master_addrs=127.14.146.254:45929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:52.776892 28909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:52.777076 28909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:52.782557 28916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.782600 28923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.782562 28919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.782829 28909 server_base.cc:1034] running on GCE node
I20260808 21:01:52.783063 28909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:52.783354 28909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:52.784525 28909 hybrid_clock.cc:648] HybridClock initialized: now 1786222912784516 us; error 35 us; skew 500 ppm
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222912, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:52.787101 28909 init.cc:377] Logged in from keytab as oryx/127.14.146.194@KRBTEST.COM (short username oryx)
I20260808 21:01:52.787580 28909 webserver.cc:460] Webserver started at http://127.14.146.194:45133/ using document root <none> and password file <none>
I20260808 21:01:52.787832 28909 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:52.787928 28909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:52.789426 28909 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:52.790091 28934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.790283 28909 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:01:52.790390 28909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "615dffb77c3d4b228f2f3b858a3457e3"
format_stamp: "Formatted at 2026-08-08 21:01:52 on dist-test-slave-t3q3"
server_key: "b68eab5ebd6367f0af53020a603e3358"
server_key_iv: "68c16279821459d881ce82c20f71c006"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.790748 28909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:52.805737 28909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:52.807688 28909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:52.807863 28909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:52.808166 28909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:52.808494 28909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:52.808550 28909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.808593 28909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:52.808620 28909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.814906 28909 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:43917
I20260808 21:01:52.814951 29107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:43917 every 8 connection(s)
I20260808 21:01:52.815323 28909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:01:52.819813 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 28909
I20260808 21:01:52.820201 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:42063
--local_ip_for_outbound_sockets=127.14.146.195
--tserver_master_addrs=127.14.146.254:45929
--webserver_port=39461
--webserver_interface=127.14.146.195
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.146.195
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:52.823640 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.816037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:42345)
0808 21:01:52.816234 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.816289 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.816809 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.817089 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.817093 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.817688 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.817883 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.817888 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.818621 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.818622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.819471 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.819473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.820000 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.820002 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.820213 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.820827 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.820836 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.823445 (+ 2609us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":115,"threads_started":1}
W20260808 21:01:52.823670 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.816048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:42345 (local address 127.14.146.254:45929)
0808 21:01:52.816151 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.816153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.816375 (+ 222us) server_negotiation.cc:407] Connection header received
0808 21:01:52.816925 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.816926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.816942 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.817007 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.818007 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.818514 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.819591 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.819903 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.819977 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.823585 (+ 3608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:42345: BlockingRecv error: recv got EOF from 127.14.146.194:42345 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 21:01:52.823975 29108 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:45929 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.146.254:45929: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:52.828812 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.824343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:33541)
0808 21:01:52.824388 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.824397 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.824437 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.824580 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.824581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.824721 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.824765 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.824767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.825407 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.825408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.825921 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.825923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.826304 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.826305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.826375 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.826853 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.826857 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.828730 (+ 1873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 21:01:52.828869 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.824407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:33541 (local address 127.14.146.254:45929)
0808 21:01:52.824473 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.824476 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.824483 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:01:52.824506 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.824507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.824516 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.824575 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.824843 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.825323 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.826008 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.826216 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.826303 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.828801 (+ 2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:33541: BlockingRecv error: recv got EOF from 127.14.146.194:33541 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:52.833683 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.829145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:55963)
0808 21:01:52.829185 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.829195 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.829231 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.829400 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.829401 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.829504 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.829532 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.829533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.830469 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.830470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.830941 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.830943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.831432 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.831433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.831470 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.831905 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.831909 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.833640 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 21:01:52.833804 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.829190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:55963 (local address 127.14.146.254:45929)
0808 21:01:52.829265 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.829267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.829279 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:01:52.829305 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.829306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.829317 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.829391 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.829607 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.830370 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.831022 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.831353 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.831436 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.833745 (+ 2309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:55963: BlockingRecv error: recv got EOF from 127.14.146.194:55963 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 21:01:52.834021 29108 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 21:01:52.909269 29113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:01:52.909468 29113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:01:52.909492 29113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:01:52.910656 29113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:01:52.910701 29113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:01:52.910727 29113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:01:52.912353 29113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/krb5kdc/oryx_127.14.146.195.keytab
--principal=oryx/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:42063
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=39461
--tserver_master_addrs=127.14.146.254:45929
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:01:52.912588 29113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:01:52.912839 29113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:01:52.918166 29118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.918144 29124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:01:52.918138 29120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:01:52.918377 29113 server_base.cc:1034] running on GCE node
I20260808 21:01:52.918587 29113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:01:52.918789 29113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:01:52.919971 29113 hybrid_clock.cc:648] HybridClock initialized: now 1786222912919964 us; error 44 us; skew 500 ppm
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222912, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:01:52.922437 29113 init.cc:377] Logged in from keytab as oryx/127.14.146.195@KRBTEST.COM (short username oryx)
I20260808 21:01:52.922880 29113 webserver.cc:460] Webserver started at http://127.14.146.195:39461/ using document root <none> and password file <none>
I20260808 21:01:52.923127 29113 fs_manager.cc:359] Metadata directory not provided
I20260808 21:01:52.923211 29113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:01:52.924616 29113 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:01:52.925244 29133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.925412 29113 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:01:52.925519 29113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "181d11f0829c47cfad4d47c3ec0fcff9"
format_stamp: "Formatted at 2026-08-08 21:01:52 on dist-test-slave-t3q3"
server_key: "69cf10f8f40d15f9b641a434d1a87402"
server_key_iv: "3e264788d4fd7da3f2ee175a6732900e"
server_key_version: "encryptionkey@0"
I20260808 21:01:52.925863 29113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:01:52.937958 29113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:01:52.939744 29113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:01:52.939908 29113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:01:52.940225 29113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:01:52.940547 29113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:01:52.940603 29113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.940641 29113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:01:52.940668 29113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:01:52.946633 29113 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:42063
I20260808 21:01:52.946738 29312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:42063 every 8 connection(s)
I20260808 21:01:52.947068 29113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 21:01:52.954227 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.947814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:50731 (local address 127.14.146.254:45929)
0808 21:01:52.947906 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.947909 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.948112 (+ 203us) server_negotiation.cc:407] Connection header received
0808 21:01:52.948642 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.948643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.948654 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.948707 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.949622 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.950109 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.951100 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.951286 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.951341 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.954177 (+ 2836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:50731: BlockingRecv error: recv got EOF from 127.14.146.195:50731 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 21:01:52.954242 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.947791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:50731)
0808 21:01:52.947965 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.948001 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.948548 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.948762 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.948766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.949343 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.949536 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.949541 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.950189 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.950190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.951019 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.951021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.951359 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.951360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.951462 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.951917 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.951925 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.954083 (+ 2158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":107,"threads_started":1}
W20260808 21:01:52.954602 29314 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:45929 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.146.254:45929: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
I20260808 21:01:52.957056 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 29113
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:52.959249 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.954828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:52901)
0808 21:01:52.954883 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.954895 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.954944 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.955192 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.955193 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.955309 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.955357 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.955358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.955953 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.955953 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.956527 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.956529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.956847 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.956847 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.956897 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.957384 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.957389 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.959200 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 21:01:52.959352 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.955030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:52901 (local address 127.14.146.254:45929)
0808 21:01:52.955088 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.955090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.955096 (+ 6us) server_negotiation.cc:407] Connection header received
0808 21:01:52.955116 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.955117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.955124 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.955166 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.955422 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.955883 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.956598 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.956782 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.956875 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.959290 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:52901: BlockingRecv error: recv got EOF from 127.14.146.195:52901 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:52 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:52.964079 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.959701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:53921)
0808 21:01:52.959741 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:52.959756 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:52.959786 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:52.959919 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:52.959919 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:52.960023 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:52.960047 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.960048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.960777 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.960778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.961313 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:52.961315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.961723 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.961724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:52.961784 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.962260 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:52.962265 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:52.963968 (+ 1703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 21:01:52.964135 28908 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:52.959764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:53921 (local address 127.14.146.254:45929)
0808 21:01:52.959801 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.959803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.959829 (+ 26us) server_negotiation.cc:407] Connection header received
0808 21:01:52.959851 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.959851 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.959859 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.959916 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.960175 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.960705 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.961423 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.961635 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.961720 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.964037 (+ 2317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:53921: BlockingRecv error: recv got EOF from 127.14.146.195:53921 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 21:01:52.964218 29314 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 21:01:52.964830 29319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:52.957474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34388 (local address 127.14.146.254:45929)
0808 21:01:52.957617 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:52.957619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:52.957715 (+ 96us) server_negotiation.cc:407] Connection header received
0808 21:01:52.957806 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:52.957807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:52.957819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:52.957874 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:52.958514 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.959048 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.960001 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:52.960322 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:52.960392 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:52.961595 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:01:52.961601 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:01:52.961601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:01:52.961615 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:01:52.963237 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:52.963648 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:52.963652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:52.963652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:52.963789 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:01:52.964014 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:01:52.964014 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:01:52.964015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:01:52.964354 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:01:52.964489 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 21:01:52.964607 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 21:01:52.964694 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":120,"threads_started":1}
Aug 08 21:01:53 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:53 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:53.705677 29321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:53.700731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:55833)
0808 21:01:53.700904 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:53.700917 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:53.700976 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:53.701115 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:53.701116 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:53.701382 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:53.701438 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:53.701440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.702141 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.702142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:53.702674 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:53.702676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.703097 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.703098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:53.703161 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:53.703608 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:53.703612 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:53.705580 (+ 1968us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":92,"threads_started":1}
W20260808 21:01:53.705742 29322 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:53.700841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:55833 (local address 127.14.146.254:45929)
0808 21:01:53.700976 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:53.700978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:53.701009 (+ 31us) server_negotiation.cc:407] Connection header received
0808 21:01:53.701033 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:53.701034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:53.701046 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:53.701097 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:53.701526 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.702053 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.702787 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.702993 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.703083 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:53.705670 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:55833: BlockingRecv error: recv got EOF from 127.14.146.193:55833 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
Aug 08 21:01:53 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:53 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:53.839658 29323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:53.834464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:38667)
0808 21:01:53.834638 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:53.834654 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:53.834733 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:53.834918 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:53.834919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:53.835119 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:53.835172 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:53.835174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.835899 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.835901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:53.836522 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:53.836525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.836912 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.836913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:53.836999 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:53.837519 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:53.837525 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:53.839578 (+ 2053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
W20260808 21:01:53.839829 29322 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:53.834593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:38667 (local address 127.14.146.254:45929)
0808 21:01:53.834671 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:53.834674 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:53.834710 (+ 36us) server_negotiation.cc:407] Connection header received
0808 21:01:53.834814 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:53.834815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:53.834841 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:53.834911 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:53.835261 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.835796 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.836620 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.836829 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.836913 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:53.839737 (+ 2824us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:38667: BlockingRecv error: recv got EOF from 127.14.146.194:38667 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 21:01:53 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:53 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:53.970688 29326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:53.964707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:47303)
0808 21:01:53.964944 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:53.964960 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:53.965051 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:53.965229 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:53.965230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:53.965440 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:53.965494 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:53.965496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.966338 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.966340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:53.966934 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:53.966936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.967349 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.967351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:53.967417 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:53.967957 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:53.967969 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:53.970609 (+ 2640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":116,"threads_started":1}
W20260808 21:01:53.970942 29322 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:53.964847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:47303 (local address 127.14.146.254:45929)
0808 21:01:53.964949 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:53.964951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:53.965028 (+ 77us) server_negotiation.cc:407] Connection header received
0808 21:01:53.965129 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:53.965130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:53.965144 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:53.965219 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:53.965603 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.966236 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.967041 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:53.967254 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:53.967348 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:53.970875 (+ 3527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:47303: BlockingRecv error: recv got EOF from 127.14.146.195:47303 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 21:01:54 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:54 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:54.711386 29327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:54.706266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:37803)
0808 21:01:54.706434 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:54.706447 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:54.706511 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:54.706671 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:54.706672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:54.706864 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:54.706922 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:54.706924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.707603 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.707604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:54.708235 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:54.708237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.708589 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.708590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:54.708637 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:54.709239 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:54.709245 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:54.711285 (+ 2040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":98,"threads_started":1}
W20260808 21:01:54.711444 29328 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:54.706361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:37803 (local address 127.14.146.254:45929)
0808 21:01:54.706483 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:54.706485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:54.706495 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:54.706579 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:54.706580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:54.706589 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:54.706649 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:54.707006 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.707531 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.708315 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.708516 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.708572 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:54.711371 (+ 2799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:37803: BlockingRecv error: recv got EOF from 127.14.146.193:37803 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
Aug 08 21:01:54 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:54 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:54.845638 29330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:54.840352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:41431)
0808 21:01:54.840575 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:54.840592 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:54.840684 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:54.840867 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:54.840869 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:54.841060 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:54.841133 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:54.841136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.841948 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.841949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:54.842595 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:54.842598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.842974 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.842975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:54.843024 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:54.843509 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:54.843514 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:54.845577 (+ 2063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":87,"threads_started":1}
W20260808 21:01:54.845779 29328 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:54.840463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:41431 (local address 127.14.146.254:45929)
0808 21:01:54.840584 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:54.840587 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:54.840674 (+ 87us) server_negotiation.cc:407] Connection header received
0808 21:01:54.840752 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:54.840754 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:54.840770 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:54.840847 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:54.841250 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.841847 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.842684 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.842900 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.842961 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:54.845687 (+ 2726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:41431: BlockingRecv error: recv got EOF from 127.14.146.194:41431 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 08 21:01:54 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:54 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:54.975732 29333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:54.971218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:36887)
0808 21:01:54.971372 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:54.971387 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:54.971447 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:54.971583 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:54.971584 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:54.971756 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:54.971807 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:54.971809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.972484 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.972485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:54.973025 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:54.973027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.973386 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.973387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:54.973432 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:54.973884 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:54.973888 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:54.975662 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":72,"threads_started":1}
W20260808 21:01:54.975824 29328 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:54.971360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:36887 (local address 127.14.146.254:45929)
0808 21:01:54.971419 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:54.971421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:54.971433 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:01:54.971500 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:54.971501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:54.971513 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:54.971567 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:54.971871 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.972418 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.973122 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:54.973310 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:54.973372 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:54.975756 (+ 2384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:36887: BlockingRecv error: recv got EOF from 127.14.146.195:36887 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 21:01:55 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:55 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:55.721354 29335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:55.711933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:46387)
0808 21:01:55.712126 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:55.712139 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:55.712230 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:55.712403 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:55.712405 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:55.712662 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:55.712722 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:55.712724 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.713644 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.713645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:55.714251 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:55.714254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.714660 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.714661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:55.714704 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:55.719271 (+ 4567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:55.719276 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:55.721291 (+ 2015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":61,"threads_started":1}
W20260808 21:01:55.721503 29336 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:55.712055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:46387 (local address 127.14.146.254:45929)
0808 21:01:55.712215 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:55.712217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:55.712227 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:01:55.712280 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:55.712281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:55.712292 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:55.712352 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:55.712822 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.713563 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.714366 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.714582 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.714634 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:55.721408 (+ 6774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:46387: BlockingRecv error: recv got EOF from 127.14.146.193:46387 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":66,"threads_started":1}
Aug 08 21:01:55 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:55 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:55.851445 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:55.846286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:35419)
0808 21:01:55.846447 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:55.846459 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:55.846518 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:55.846692 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:55.846693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:55.847089 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:55.847155 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:55.847158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.847906 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.847908 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:55.848517 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:55.848519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.848903 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.848904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:55.848966 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:55.849453 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:55.849457 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:55.851378 (+ 1921us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
W20260808 21:01:55.851567 29336 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:55.846390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:35419 (local address 127.14.146.254:45929)
0808 21:01:55.846487 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:55.846489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:55.846502 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:01:55.846598 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:55.846599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:55.846611 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:55.846670 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:55.847260 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.847779 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.848621 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.848822 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.848883 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:55.851487 (+ 2604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:35419: BlockingRecv error: recv got EOF from 127.14.146.194:35419 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 21:01:55 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:55 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:55.981025 29339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:55.976290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:35591)
0808 21:01:55.976417 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:55.976427 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:55.976484 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:55.976614 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:55.976615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:55.976783 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:55.976853 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:55.976855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.977688 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.977689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:55.978237 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:55.978239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.978606 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.978607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:55.978649 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:55.979157 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:55.979162 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:55.980967 (+ 1805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
W20260808 21:01:55.981171 29336 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:55.976348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:35591 (local address 127.14.146.254:45929)
0808 21:01:55.976417 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:55.976419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:55.976487 (+ 68us) server_negotiation.cc:407] Connection header received
0808 21:01:55.976530 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:55.976530 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:55.976544 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:55.976599 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:55.976953 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.977553 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.978332 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:55.978529 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:55.978592 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:55.981086 (+ 2494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:35591: BlockingRecv error: recv got EOF from 127.14.146.195:35591 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 21:01:56 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:56 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:56.726640 29341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:56.721875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:40197)
0808 21:01:56.722027 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:56.722046 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:56.722105 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:56.722262 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:56.722263 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:56.722432 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:56.722488 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:56.722489 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.723196 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.723197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:56.723761 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:56.723763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.724165 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.724166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:56.724214 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:56.724786 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:56.724790 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:56.726582 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
W20260808 21:01:56.726814 29342 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:56.721978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:40197 (local address 127.14.146.254:45929)
0808 21:01:56.722131 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:56.722133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:56.722141 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:56.722164 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:56.722165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:56.722175 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:56.722243 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:56.722561 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.723098 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.723846 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.724097 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.724153 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:56.726709 (+ 2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:40197: BlockingRecv error: recv got EOF from 127.14.146.193:40197 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":58,"threads_started":1}
Aug 08 21:01:56 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:56 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:56.857154 29344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:56.852211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:49059)
0808 21:01:56.852404 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:56.852419 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:56.852500 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:56.852685 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:56.852687 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:56.852903 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:56.852954 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:56.852956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.853656 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.853657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:56.854215 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:56.854216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.854607 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.854608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:56.854669 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:56.855183 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:56.855188 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:56.857053 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":106,"threads_started":1}
W20260808 21:01:56.857209 29342 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:56.852353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:49059 (local address 127.14.146.254:45929)
0808 21:01:56.852428 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:56.852431 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:56.852476 (+ 45us) server_negotiation.cc:407] Connection header received
0808 21:01:56.852585 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:56.852587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:56.852599 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:56.852677 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:56.853058 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.853568 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.854330 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.854531 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.854611 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:56.857144 (+ 2533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:49059: BlockingRecv error: recv got EOF from 127.14.146.194:49059 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 21:01:56 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:56 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:56.986361 29345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:56.981464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:36903)
0808 21:01:56.981659 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:56.981672 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:56.981765 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:56.981930 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:56.981931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:56.982128 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:56.982178 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:56.982180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.982889 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.982890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:56.983447 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:56.983449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.983843 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.983844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:56.983911 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:56.984382 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:56.984386 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:56.986259 (+ 1873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":100,"threads_started":1}
W20260808 21:01:56.986416 29342 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:56.981550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:36903 (local address 127.14.146.254:45929)
0808 21:01:56.981642 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:56.981644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:56.981746 (+ 102us) server_negotiation.cc:407] Connection header received
0808 21:01:56.981844 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:56.981845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:56.981861 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:56.981910 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:56.982261 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.982793 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.983544 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:56.983751 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:56.983840 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:56.986348 (+ 2508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:36903: BlockingRecv error: recv got EOF from 127.14.146.195:36903 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 21:01:57 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:57 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:57.732564 29347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:57.727180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:46989)
0808 21:01:57.727369 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:57.727386 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:57.727455 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:57.727648 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:57.727649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:57.727854 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:57.727921 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:57.727923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.728870 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.728871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:57.729458 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:57.729460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.729914 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.729915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:57.729974 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:57.730468 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:57.730472 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:57.732456 (+ 1984us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":87,"threads_started":1}
W20260808 21:01:57.732609 29348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:57.727263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:46989 (local address 127.14.146.254:45929)
0808 21:01:57.727434 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:57.727436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:57.727444 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:01:57.727521 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:57.727521 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:57.727532 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:57.727598 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:57.728032 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.728764 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.729629 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.729827 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.729885 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:57.732539 (+ 2654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:46989: BlockingRecv error: recv got EOF from 127.14.146.193:46989 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":108,"threads_started":1}
Aug 08 21:01:57 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:57 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:57.862466 29350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:57.857735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:34659)
0808 21:01:57.857931 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:57.857944 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:57.858016 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:57.858147 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:57.858148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:57.858328 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:57.858387 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:57.858388 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.859047 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.859049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:57.859602 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:57.859607 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.859954 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.859954 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:57.859999 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:57.860501 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:57.860505 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:57.862402 (+ 1897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":78,"threads_started":1}
W20260808 21:01:57.862596 29348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:57.857905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:34659 (local address 127.14.146.254:45929)
0808 21:01:57.857971 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:57.857973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:57.857998 (+ 25us) server_negotiation.cc:407] Connection header received
0808 21:01:57.858072 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:57.858073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:57.858083 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:57.858122 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:57.858459 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.858962 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.859693 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.859886 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.859940 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:57.862515 (+ 2575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:34659: BlockingRecv error: recv got EOF from 127.14.146.194:34659 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 21:01:57 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:57 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:57.991878 29354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:57.986899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:60837)
0808 21:01:57.987141 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:57.987158 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:57.987272 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:57.987470 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:57.987472 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:57.987749 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:57.987814 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:57.987817 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.988590 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.988591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:57.989146 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:57.989147 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.989491 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.989492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:57.989536 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:57.989983 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:57.989988 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:57.991767 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":114,"threads_started":1}
W20260808 21:01:57.992005 29348 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:57.987013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:60837 (local address 127.14.146.254:45929)
0808 21:01:57.987187 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:57.987189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:57.987253 (+ 64us) server_negotiation.cc:407] Connection header received
0808 21:01:57.987361 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:57.987362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:57.987378 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:57.987437 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:57.987927 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.988499 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.989233 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:57.989422 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:57.989480 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:57.991906 (+ 2426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:60837: BlockingRecv error: recv got EOF from 127.14.146.195:60837 (error 108)
Metrics: {"server-negotiator.queue_time_us":146}
Aug 08 21:01:58 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:58 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:58.738492 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:58.733170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:46815)
0808 21:01:58.733345 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:58.733360 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:58.733443 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:58.733649 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:58.733651 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:58.733871 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:58.733937 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:58.733939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.734927 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.734928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:58.735607 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:58.735610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.736003 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.736004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:58.736081 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:58.736530 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:58.736534 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:58.738392 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
W20260808 21:01:58.738547 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:58.733260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:46815 (local address 127.14.146.254:45929)
0808 21:01:58.733375 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:58.733377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:58.733420 (+ 43us) server_negotiation.cc:407] Connection header received
0808 21:01:58.733511 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:58.733512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:58.733523 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:58.733629 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:58.734028 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.734828 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.735704 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.735925 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.736005 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:58.738474 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:46815: BlockingRecv error: recv got EOF from 127.14.146.193:46815 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":52,"threads_started":1}
Aug 08 21:01:58 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:58 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:58.867789 29359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:58.863034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:46409)
0808 21:01:58.863222 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:58.863234 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:58.863295 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:58.863433 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:58.863434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:58.863618 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:58.863673 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:58.863674 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.864403 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.864404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:58.864935 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:58.864937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.865284 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.865285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:58.865328 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:58.865774 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:58.865779 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:58.867689 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":66,"threads_started":1}
W20260808 21:01:58.867839 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:58.863215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:46409 (local address 127.14.146.254:45929)
0808 21:01:58.863280 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:58.863282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:58.863298 (+ 16us) server_negotiation.cc:407] Connection header received
0808 21:01:58.863357 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:58.863357 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:58.863367 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:58.863409 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:58.863743 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.864323 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.865013 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.865216 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.865270 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:58.867774 (+ 2504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:46409: BlockingRecv error: recv got EOF from 127.14.146.194:46409 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 21:01:58 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:58 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:58.997484 29363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:58.992426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:56327)
0808 21:01:58.992604 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:58.992616 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:58.992705 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:58.992861 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:58.992862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:58.993065 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:58.993113 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:58.993115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.993888 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.993889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:58.994424 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:58.994426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.994826 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.994827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:58.994894 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:58.995427 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:58.995431 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:58.997387 (+ 1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":113,"threads_started":1}
W20260808 21:01:58.997526 29358 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:58.992517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:56327 (local address 127.14.146.254:45929)
0808 21:01:58.992589 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:58.992592 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:58.992683 (+ 91us) server_negotiation.cc:407] Connection header received
0808 21:01:58.992771 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:58.992772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:58.992786 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:58.992850 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:58.993200 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.993793 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.994514 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:58.994735 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:58.994823 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:58.997463 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:56327: BlockingRecv error: recv got EOF from 127.14.146.195:56327 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 21:01:59 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:59 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:59.745814 29366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:59.739006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:56961)
0808 21:01:59.739139 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:59.739152 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:59.739222 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:59.739424 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:59.739425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:59.739658 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:59.739721 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:59.739723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.740834 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.740835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:59.741867 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:59.741870 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.742320 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.742321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:59.742385 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:59.742941 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:59.742947 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:59.745707 (+ 2760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
W20260808 21:01:59.745890 29367 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:59.739067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:56961 (local address 127.14.146.254:45929)
0808 21:01:59.739191 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:59.739194 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:59.739205 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:01:59.739319 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:59.739320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:59.739333 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:59.739393 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:59.739825 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.740742 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.741972 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.742239 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.742317 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:59.745812 (+ 3495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:56961: BlockingRecv error: recv got EOF from 127.14.146.193:56961 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":62,"threads_started":1}
Aug 08 21:01:59 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:59 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:01:59.873414 29368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:59.868308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:49711)
0808 21:01:59.868522 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:59.868536 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:59.868625 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:59.868787 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:59.868788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:59.868994 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:59.869047 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:59.869048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.869743 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.869744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:59.870284 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:59.870286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.870672 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.870673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:59.870732 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:59.871248 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:01:59.871252 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:01:59.873315 (+ 2063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":104,"threads_started":1}
W20260808 21:01:59.873467 29367 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:59.868436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:49711 (local address 127.14.146.254:45929)
0808 21:01:59.868529 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:59.868531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:59.868604 (+ 73us) server_negotiation.cc:407] Connection header received
0808 21:01:59.868684 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:59.868685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:59.868699 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:59.868777 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:59.869131 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.869655 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.870371 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.870576 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.870671 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:01:59.873401 (+ 2730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:49711: BlockingRecv error: recv got EOF from 127.14.146.194:49711 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 21:01:59 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:01:59 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:00.003147 29369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:01:59.998105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:53643)
0808 21:01:59.998293 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 21:01:59.998305 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:01:59.998383 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:01:59.998519 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:01:59.998520 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:01:59.998697 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:01:59.998751 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:59.998753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.999449 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:01:59.999449 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:01:59.999970 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:01:59.999971 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.000339 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.000340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:00.000390 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:00.000946 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:00.000953 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:00.003043 (+ 2090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":83,"threads_started":1}
W20260808 21:02:00.003188 29367 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:01:59.998240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:53643 (local address 127.14.146.254:45929)
0808 21:01:59.998313 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 21:01:59.998315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:01:59.998380 (+ 65us) server_negotiation.cc:407] Connection header received
0808 21:01:59.998431 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:01:59.998432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:01:59.998445 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:01:59.998504 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:01:59.998858 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:01:59.999376 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.000047 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.000264 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.000318 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:00.003124 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:53643: BlockingRecv error: recv got EOF from 127.14.146.195:53643 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 21:02:00 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:00 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:00.755155 29370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:00.746663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:37413)
0808 21:02:00.746805 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:00.746818 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:00.746888 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:00.747069 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:00.747070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:00.747243 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:00.747301 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:00.747302 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.747947 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.747947 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:00.748541 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:00.748542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.748917 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.748918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:00.748970 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:00.752817 (+ 3847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:00.752823 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:00.755054 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
W20260808 21:02:00.755283 29371 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:00.746823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:37413 (local address 127.14.146.254:45929)
0808 21:02:00.746940 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:00.746942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:00.746957 (+ 15us) server_negotiation.cc:407] Connection header received
0808 21:02:00.746980 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:00.746981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:00.746991 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:00.747049 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:00.747367 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.747873 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.748620 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.748821 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.748878 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:00.755146 (+ 6268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:37413: BlockingRecv error: recv got EOF from 127.14.146.193:37413 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":70,"threads_started":1}
Aug 08 21:02:00 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:00 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:00.879140 29372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:00.874065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:46425)
0808 21:02:00.874222 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:00.874236 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:00.874310 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:00.874453 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:00.874454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:00.874630 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:00.874693 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:00.874694 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.875497 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.875497 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:00.876036 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:00.876037 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.876445 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.876446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:00.876491 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:00.876971 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:00.876976 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:00.879067 (+ 2091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":120,"threads_started":1}
W20260808 21:02:00.879215 29371 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:00.874141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:46425 (local address 127.14.146.254:45929)
0808 21:02:00.874249 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:00.874251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:00.874298 (+ 47us) server_negotiation.cc:407] Connection header received
0808 21:02:00.874361 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:00.874362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:00.874372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:00.874433 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:00.874772 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.875421 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.876187 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:00.876378 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:00.876431 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:00.879163 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:46425: BlockingRecv error: recv got EOF from 127.14.146.194:46425 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 21:02:01 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:01 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:01.009137 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:01.003788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:45253)
0808 21:02:01.004001 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:01.004010 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:01.004126 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:01.004314 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:01.004316 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:01.004505 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:01.004557 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:01.004559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.005252 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.005253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:01.005815 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:01.005816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.006205 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.006206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:01.006274 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:01.006755 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:01.006761 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:01.009008 (+ 2247us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":120,"threads_started":1}
W20260808 21:02:01.009171 29371 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:01.003866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:45253 (local address 127.14.146.254:45929)
0808 21:02:01.003946 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:01.003949 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:01.004095 (+ 146us) server_negotiation.cc:407] Connection header received
0808 21:02:01.004210 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:01.004211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:01.004225 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:01.004306 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:01.004643 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.005155 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.005902 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.006111 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.006202 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:01.009104 (+ 2902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:45253: BlockingRecv error: recv got EOF from 127.14.146.195:45253 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 21:02:01 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:01 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:01.760363 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:01.755645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:41381)
0808 21:02:01.755812 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:01.755823 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:01.755877 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:01.756049 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:01.756050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:01.756255 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:01.756309 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:01.756311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.756996 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.756997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:01.757545 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:01.757546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.757880 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.757881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:01.757931 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:01.758382 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:01.758387 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:01.760245 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":100,"threads_started":1}
W20260808 21:02:01.760475 29376 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:01.755761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:41381 (local address 127.14.146.254:45929)
0808 21:02:01.755905 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:01.755909 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:01.755923 (+ 14us) server_negotiation.cc:407] Connection header received
0808 21:02:01.755948 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:01.755949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:01.755960 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:01.756030 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:01.756392 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.756912 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.757621 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.757816 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.757867 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:01.760387 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:41381: BlockingRecv error: recv got EOF from 127.14.146.193:41381 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
Aug 08 21:02:01 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:01 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:01.885320 29377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:01.879880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:53339)
0808 21:02:01.880175 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:01.880191 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:01.880306 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:01.880579 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:01.880580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:01.880824 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:01.880893 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:01.880896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.881670 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.881671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:01.882200 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:01.882201 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.882579 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.882580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:01.882624 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:01.883127 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:01.883132 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:01.885213 (+ 2081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":218,"threads_started":1}
W20260808 21:02:01.885476 29376 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:01.880119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:53339 (local address 127.14.146.254:45929)
0808 21:02:01.880192 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:01.880194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:01.880287 (+ 93us) server_negotiation.cc:407] Connection header received
0808 21:02:01.880443 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:01.880444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:01.880473 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:01.880530 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:01.880997 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.881595 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.882310 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:01.882510 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:01.882569 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:01.885328 (+ 2759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:53339: BlockingRecv error: recv got EOF from 127.14.146.194:53339 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 21:02:02 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:02 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:02.014894 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:02.009722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:33269)
0808 21:02:02.009916 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:02.009928 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:02.010001 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:02.010144 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:02.010145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:02.010331 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:02.010383 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:02.010384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.011116 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.011117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:02.011854 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:02.011857 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.012265 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.012266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:02.012311 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:02.012784 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:02.012790 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:02.014822 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":136,"threads_started":1}
W20260808 21:02:02.014989 29376 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:02.009826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:33269 (local address 127.14.146.254:45929)
0808 21:02:02.009902 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:02.009904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:02.009998 (+ 94us) server_negotiation.cc:407] Connection header received
0808 21:02:02.010050 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:02.010051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:02.010063 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:02.010126 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:02.010446 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.011029 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.011947 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.012193 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.012256 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:02.014921 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:33269: BlockingRecv error: recv got EOF from 127.14.146.195:33269 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 21:02:02 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:02 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:02.765664 29379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:02.760883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:51005)
0808 21:02:02.761066 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:02.761078 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:02.761172 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:02.761318 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:02.761319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:02.761494 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:02.761548 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:02.761549 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.762182 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.762182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:02.762718 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:02.762720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.763033 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.763033 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:02.763074 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:02.763545 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:02.763549 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:02.765563 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":122,"threads_started":1}
W20260808 21:02:02.765733 29380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:02.760965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:51005 (local address 127.14.146.254:45929)
0808 21:02:02.761092 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:02.761094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:02.761168 (+ 74us) server_negotiation.cc:407] Connection header received
0808 21:02:02.761231 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:02.761231 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:02.761243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:02.761303 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:02.761607 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.762115 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.762784 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.762970 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.763020 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:02.765639 (+ 2619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:51005: BlockingRecv error: recv got EOF from 127.14.146.193:51005 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":54,"threads_started":1}
Aug 08 21:02:02 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:02 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:02.891269 29381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:02.885801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:35965)
0808 21:02:02.885986 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:02.885999 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:02.886121 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:02.886305 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:02.886306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:02.886581 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:02.886648 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:02.886655 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.887409 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.887410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:02.888017 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:02.888019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.888558 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.888560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:02.888620 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:02.889159 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:02.889163 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:02.891207 (+ 2044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":96,"threads_started":1}
W20260808 21:02:02.891443 29380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:02.885895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:35965 (local address 127.14.146.254:45929)
0808 21:02:02.885959 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:02.885962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:02.886071 (+ 109us) server_negotiation.cc:407] Connection header received
0808 21:02:02.886203 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:02.886204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:02.886224 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:02.886297 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:02.886749 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.887316 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.888270 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:02.888470 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:02.888541 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:02.891356 (+ 2815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:35965: BlockingRecv error: recv got EOF from 127.14.146.194:35965 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 21:02:03 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:03 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:03.020499 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:03.015436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:48775)
0808 21:02:03.015607 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:03.015618 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:03.015695 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:03.015862 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:03.015863 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:03.016121 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:03.016186 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:03.016188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.016987 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.016988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:03.017661 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:03.017663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.018048 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.018049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:03.018105 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:03.018593 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:03.018597 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:03.020401 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":101,"threads_started":1}
W20260808 21:02:03.020548 29380 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:03.015615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:48775 (local address 127.14.146.254:45929)
0808 21:02:03.015700 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:03.015702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:03.015712 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:02:03.015764 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:03.015765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:03.015779 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:03.015853 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:03.016268 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.016925 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.017748 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.017955 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.018047 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:03.020486 (+ 2439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:48775: BlockingRecv error: recv got EOF from 127.14.146.195:48775 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 21:02:03 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:03 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:03.771071 29383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:03.766183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:37361)
0808 21:02:03.766328 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:03.766340 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:03.766402 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:03.766584 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:03.766585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:03.766781 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:03.766835 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:03.766836 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.767518 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.767518 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:03.768051 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:03.768053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.768422 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.768423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:03.768468 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:03.768920 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:03.768924 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:03.770994 (+ 2070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
W20260808 21:02:03.771219 29384 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:03.766305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:37361 (local address 127.14.146.254:45929)
0808 21:02:03.766437 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:03.766439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:03.766448 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:02:03.766474 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:03.766474 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:03.766485 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:03.766579 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:03.766928 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.767443 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.768152 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.768356 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.768406 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:03.771125 (+ 2719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:37361: BlockingRecv error: recv got EOF from 127.14.146.193:37361 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
Aug 08 21:02:03 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:03 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:03.896960 29385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:03.891728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:49793)
0808 21:02:03.891875 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:03.891885 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:03.891943 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:03.892124 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:03.892125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:03.892373 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:03.892448 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:03.892451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.893234 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.893235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:03.893925 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:03.893928 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.894303 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.894304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:03.894347 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:03.894897 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:03.894902 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:03.896845 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260808 21:02:03.897001 29384 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:03.891793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:49793 (local address 127.14.146.254:45929)
0808 21:02:03.891850 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:03.891852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:03.891928 (+ 76us) server_negotiation.cc:407] Connection header received
0808 21:02:03.892003 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:03.892004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:03.892014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:03.892106 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:03.892541 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.893135 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.894016 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:03.894233 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:03.894291 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:03.896936 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:49793: BlockingRecv error: recv got EOF from 127.14.146.194:49793 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 21:02:04 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:04 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:04.026623 29386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:04.021205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:55057)
0808 21:02:04.021442 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:04.021461 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:04.021589 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:04.021774 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:04.021775 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:04.022006 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:04.022063 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:04.022065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.022948 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.022949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:04.023658 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:04.023661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.024004 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.024005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:04.024049 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:04.024630 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:04.024635 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:04.026545 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":113,"threads_started":1}
W20260808 21:02:04.026777 29384 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:04.021377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:55057 (local address 127.14.146.254:45929)
0808 21:02:04.021476 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:04.021478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:04.021566 (+ 88us) server_negotiation.cc:407] Connection header received
0808 21:02:04.021672 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:04.021673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:04.021694 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:04.021767 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:04.022155 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.022812 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.023736 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.023931 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.023993 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:04.026676 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:55057: BlockingRecv error: recv got EOF from 127.14.146.195:55057 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 08 21:02:04 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:04 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:04.776978 29387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:04.771586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:52147)
0808 21:02:04.771766 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:04.771777 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:04.771832 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:04.772021 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:04.772021 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:04.772272 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:04.772325 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:04.772327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.773002 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.773002 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:04.773546 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:04.773547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.773923 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.773925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:04.773978 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:04.774477 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:04.774482 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:04.776863 (+ 2381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":105,"threads_started":1}
W20260808 21:02:04.777060 29391 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:04.771729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:52147 (local address 127.14.146.254:45929)
0808 21:02:04.771881 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:04.771883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:04.771892 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:02:04.771919 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:04.771919 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:04.771930 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:04.772002 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:04.772403 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.772921 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.773619 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.773818 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.773874 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:04.776951 (+ 3077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:52147: BlockingRecv error: recv got EOF from 127.14.146.193:52147 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":98,"threads_started":1}
Aug 08 21:02:04 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:04 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:04.902128 29393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:04.897457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:57955)
0808 21:02:04.897600 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:04.897612 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:04.897694 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:04.897829 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:04.897830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:04.898024 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:04.898074 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:04.898076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.898713 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.898714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:04.899267 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:04.899268 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.899586 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.899587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:04.899630 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:04.900189 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:04.900194 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:04.902067 (+ 1873us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
W20260808 21:02:04.902297 29391 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:04.897537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:57955 (local address 127.14.146.254:45929)
0808 21:02:04.897593 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:04.897594 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:04.897693 (+ 99us) server_negotiation.cc:407] Connection header received
0808 21:02:04.897756 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:04.897757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:04.897767 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:04.897810 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:04.898141 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.898640 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.899337 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:04.899523 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:04.899575 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:04.902220 (+ 2645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:57955: BlockingRecv error: recv got EOF from 127.14.146.194:57955 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 21:02:05 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:05 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:05.032163 29394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:05.027180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:33205)
0808 21:02:05.027351 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:05.027362 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:05.027448 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:05.027619 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:05.027620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:05.027812 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:05.027862 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:05.027863 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.028596 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.028597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:05.029201 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:05.029203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.029582 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.029583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:05.029640 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:05.030163 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:05.030173 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:05.032045 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":73,"threads_started":1}
W20260808 21:02:05.032266 29391 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:05.027246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:33205 (local address 127.14.146.254:45929)
0808 21:02:05.027330 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:05.027332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:05.027429 (+ 97us) server_negotiation.cc:407] Connection header received
0808 21:02:05.027506 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:05.027507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:05.027521 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:05.027595 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:05.027942 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.028510 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.029289 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.029492 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.029579 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:05.032176 (+ 2597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:33205: BlockingRecv error: recv got EOF from 127.14.146.195:33205 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 21:02:05 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:05 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:05.787552 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:05.777543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:39897)
0808 21:02:05.777721 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:05.777733 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:05.777789 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:05.777942 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:05.777943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:05.778118 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:05.778170 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:05.778171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.778856 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.778856 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:05.779393 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:05.779395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.779731 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.779732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:05.779774 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:05.784955 (+ 5181us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:05.784961 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:05.787439 (+ 2478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":88,"threads_started":1}
W20260808 21:02:05.787688 29396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:05.777655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:39897 (local address 127.14.146.254:45929)
0808 21:02:05.777825 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:05.777827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:05.777840 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:02:05.777867 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:05.777867 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:05.777877 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:05.777937 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:05.778258 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.778781 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.779467 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.779662 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.779715 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:05.787613 (+ 7898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:39897: BlockingRecv error: recv got EOF from 127.14.146.193:39897 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
Aug 08 21:02:05 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:05 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:05.907446 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:05.902596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:46991)
0808 21:02:05.902739 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:05.902753 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:05.902828 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:05.902981 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:05.902981 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:05.903160 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:05.903226 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:05.903228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.903854 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.903855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:05.904499 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:05.904501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.904839 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.904840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:05.904882 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:05.905394 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:05.905399 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:05.907329 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
W20260808 21:02:05.907486 29396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:05.902731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:46991 (local address 127.14.146.254:45929)
0808 21:02:05.902795 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:05.902796 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:05.902809 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:02:05.902898 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:05.902899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:05.902910 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:05.902959 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:05.903293 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.903788 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.904574 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:05.904772 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:05.904828 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:05.907420 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:46991: BlockingRecv error: recv got EOF from 127.14.146.194:46991 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 21:02:06 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:06 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:06.037205 29398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:06.032628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:48583)
0808 21:02:06.032777 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:06.032791 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:06.032868 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:06.032983 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:06.032984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:06.033169 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:06.033235 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:06.033237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.033880 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.033881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:06.034444 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:06.034446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.034783 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.034784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:06.034827 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:06.035346 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:06.035351 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:06.037129 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
W20260808 21:02:06.037297 29396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:06.032711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:48583 (local address 127.14.146.254:45929)
0808 21:02:06.032770 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:06.032773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:06.032867 (+ 94us) server_negotiation.cc:407] Connection header received
0808 21:02:06.032923 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:06.032923 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:06.032935 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:06.032971 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:06.033296 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.033810 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.034522 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.034717 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.034771 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:06.037228 (+ 2457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:48583: BlockingRecv error: recv got EOF from 127.14.146.195:48583 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 21:02:06 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:06 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:06.793351 29403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:06.788546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:39227)
0808 21:02:06.788746 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:06.788758 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:06.788817 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:06.788981 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:06.788982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:06.789170 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:06.789226 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:06.789228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.789860 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.789861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:06.790383 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:06.790385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.790722 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.790723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:06.790771 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:06.791313 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:06.791325 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:06.793291 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":97,"threads_started":1}
W20260808 21:02:06.793483 29404 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:06.788653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:39227 (local address 127.14.146.254:45929)
0808 21:02:06.788793 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:06.788795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:06.788806 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:02:06.788886 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:06.788887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:06.788897 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:06.788959 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:06.789290 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.789793 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.790452 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.790645 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.790698 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:06.793394 (+ 2696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:39227: BlockingRecv error: recv got EOF from 127.14.146.193:39227 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
Aug 08 21:02:06 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:06 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:06.912878 29405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:06.907993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:53633)
0808 21:02:06.908207 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:06.908219 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:06.908303 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:06.908469 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:06.908470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:06.908680 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:06.908731 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:06.908733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.909427 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.909428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:06.909975 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:06.909977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.910367 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.910368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:06.910430 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:06.910875 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:06.910880 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:06.912780 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":121,"threads_started":1}
W20260808 21:02:06.912957 29404 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:06.908118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:53633 (local address 127.14.146.254:45929)
0808 21:02:06.908185 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:06.908187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:06.908292 (+ 105us) server_negotiation.cc:407] Connection header received
0808 21:02:06.908367 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:06.908368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:06.908381 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:06.908460 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:06.908817 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.909340 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.910087 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:06.910291 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:06.910371 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:06.912893 (+ 2522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:53633: BlockingRecv error: recv got EOF from 127.14.146.194:53633 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 21:02:07 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:07 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.195@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:07.042577 29408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:07.037740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.195:46267)
0808 21:02:07.037950 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:07.037961 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:07.038036 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:07.038193 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:07.038194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:07.038396 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:07.038447 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:07.038449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.039142 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.039144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:07.039684 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:07.039686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.040107 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.040109 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:07.040175 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:07.040645 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:07.040650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:07.042509 (+ 1859us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":125,"threads_started":1}
W20260808 21:02:07.042711 29404 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:07.037828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:46267 (local address 127.14.146.254:45929)
0808 21:02:07.037923 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:07.037925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:07.038031 (+ 106us) server_negotiation.cc:407] Connection header received
0808 21:02:07.038094 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:07.038095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:07.038109 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:07.038184 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:07.038547 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.039057 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.039782 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.039981 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.040093 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:07.042628 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.195:46267: BlockingRecv error: recv got EOF from 127.14.146.195:46267 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 08 21:02:07 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:07 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.193@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:07.798447 29411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:07.793941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.193:57781)
0808 21:02:07.794081 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:07.794093 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:07.794161 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:07.794328 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:07.794329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:07.794497 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:07.794549 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:07.794550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.795242 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.795243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:07.795786 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:07.795787 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.796145 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.796146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:07.796207 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:07.796613 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:07.796617 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:07.798390 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
W20260808 21:02:07.798537 29413 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:07.793981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:57781 (local address 127.14.146.254:45929)
0808 21:02:07.794123 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:07.794125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:07.794137 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:02:07.794231 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:07.794232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:07.794244 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:07.794315 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:07.794617 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.795170 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.795871 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.796086 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.796140 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:07.798481 (+ 2341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.193:57781: BlockingRecv error: recv got EOF from 127.14.146.193:57781 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
Aug 08 21:02:07 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 21:02:07 dist-test-slave-t3q3 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.146.194@KRBTEST.COM for oryx/127.14.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 21:02:07.918371 29414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:07.913502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45929 (local address 127.14.146.194:33221)
0808 21:02:07.913653 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:07.913673 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:07.913744 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:07.913885 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:07.913886 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:07.914078 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:07.914129 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:07.914131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.914887 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.914889 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:07.915470 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:07.915472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.915875 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.915876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:07.915938 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:07.916413 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:07.916418 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:07.918246 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.146.254:45929: Server oryx/127.14.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
W20260808 21:02:07.918407 29413 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:07.913595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:33221 (local address 127.14.146.254:45929)
0808 21:02:07.913647 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:07.913650 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:07.913737 (+ 87us) server_negotiation.cc:407] Connection header received
0808 21:02:07.913803 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:07.913804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:07.913816 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:07.913876 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:07.914236 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.914804 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.915560 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:07.915780 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:07.915873 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:07.918340 (+ 2467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.146.194:33221: BlockingRecv error: recv got EOF from 127.14.146.194:33221 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:02:07.967250 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 28682
I20260808 21:02:07.981194 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 28909
I20260808 21:02:07.989030 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 29113
I20260808 21:02:08.002346 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 28575
2026-08-08T21:02:08Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17819 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T21:02:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:02:08Z Disabled control of system clock
I20260808 21:02:08.039907 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:36549
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:36549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 21:02:08.123682 29423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:08.123894 29423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:08.123914 29423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:08.125047 29423 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:02:08.125087 29423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:08.125100 29423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:08.125113 29423 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:02:08.125124 29423 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:02:08.126402 29423 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:36549
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:36549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:08.126600 29423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:08.126852 29423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:08.132292 29433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.132319 29436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.132299 29432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:08.132318 29423 server_base.cc:1034] running on GCE node
I20260808 21:02:08.132723 29423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:08.133038 29423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:08.134187 29423 hybrid_clock.cc:648] HybridClock initialized: now 1786222928134179 us; error 31 us; skew 500 ppm
I20260808 21:02:08.135483 29423 webserver.cc:460] Webserver started at http://127.14.146.254:32833/ using document root <none> and password file <none>
I20260808 21:02:08.135746 29423 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:08.135795 29423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:08.135934 29423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:08.137130 29423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "fbdd31bba6804d3ead921c4e7507c2b8"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "c9f44a37b342a152a5f28c7dcede8b30"
server_key_iv: "baa111b520e1f0dbc507855e4b797274"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.137562 29423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "fbdd31bba6804d3ead921c4e7507c2b8"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "c9f44a37b342a152a5f28c7dcede8b30"
server_key_iv: "baa111b520e1f0dbc507855e4b797274"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.139071 29423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 21:02:08.139945 29446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.140182 29423 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:02:08.140295 29423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "fbdd31bba6804d3ead921c4e7507c2b8"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "c9f44a37b342a152a5f28c7dcede8b30"
server_key_iv: "baa111b520e1f0dbc507855e4b797274"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.140422 29423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:08.158277 29423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:08.158648 29423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:08.158812 29423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:08.163244 29423 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:36549
I20260808 21:02:08.163300 29517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:36549 every 8 connection(s)
I20260808 21:02:08.163683 29423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:02:08.164580 29518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:08.164597 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 29423
I20260808 21:02:08.164685 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:02:08.164913 14923 external_mini_cluster.cc:1428] Setting key e3de601d99688b788fd8a657e4f4a11a
I20260808 21:02:08.168344 29518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8: Bootstrap starting.
I20260808 21:02:08.169036 29518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:08.169397 29518 log.cc:824] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:08.170260 29518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8: No bootstrap required, opened a new log
I20260808 21:02:08.170812 29521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.165559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53584 (local address 127.14.146.254:36549)
0808 21:02:08.165764 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:08.165771 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:08.165796 (+ 25us) server_negotiation.cc:407] Connection header received
0808 21:02:08.166192 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:08.166200 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:08.166260 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:08.166374 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:08.166645 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.167585 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.168744 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.169196 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.169292 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:08.170125 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:08.170128 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:08.170128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:02:08.170313 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:08.170361 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:02:08.170378 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:08.170460 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:08.170542 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 21:02:08.170624 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260808 21:02:08.172415 29518 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdd31bba6804d3ead921c4e7507c2b8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36549 } }
I20260808 21:02:08.172560 29518 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:08.172585 29518 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdd31bba6804d3ead921c4e7507c2b8, State: Initialized, Role: FOLLOWER
I20260808 21:02:08.172701 29518 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdd31bba6804d3ead921c4e7507c2b8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36549 } }
I20260808 21:02:08.172785 29518 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:02:08.172807 29518 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:02:08.172837 29518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:08.173373 29518 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdd31bba6804d3ead921c4e7507c2b8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36549 } }
I20260808 21:02:08.173462 29518 leader_election.cc:302] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbdd31bba6804d3ead921c4e7507c2b8; no voters:
I20260808 21:02:08.173595 29518 leader_election.cc:288] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:02:08.173682 29525 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:02:08.173872 29525 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [term 1 LEADER]: Becoming Leader. State: Replica: fbdd31bba6804d3ead921c4e7507c2b8, State: Running, Role: LEADER
I20260808 21:02:08.173923 29518 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:02:08.173998 29525 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdd31bba6804d3ead921c4e7507c2b8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36549 } }
I20260808 21:02:08.174427 29526 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbdd31bba6804d3ead921c4e7507c2b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdd31bba6804d3ead921c4e7507c2b8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36549 } } }
I20260808 21:02:08.174459 29529 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbdd31bba6804d3ead921c4e7507c2b8. Latest consensus state: current_term: 1 leader_uuid: "fbdd31bba6804d3ead921c4e7507c2b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbdd31bba6804d3ead921c4e7507c2b8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 36549 } } }
I20260808 21:02:08.174705 29529 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:02:08.174618 29526 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:02:08.175098 29540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:02:08.175601 29540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:02:08.177356 29540 catalog_manager.cc:1347] Generated new cluster ID: 87214f0980654a6f9b0c5f34a03c2493
I20260808 21:02:08.177421 29540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:02:08.199644 29540 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:02:08.200443 29540 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:02:08.206586 29540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbdd31bba6804d3ead921c4e7507c2b8: Generated new TSK 0
I20260808 21:02:08.206818 29540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:02:08.208472 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36549
--builtin_ntp_servers=127.14.146.212:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 21:02:08.307018 29555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:08.307225 29555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:08.307248 29555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:08.308545 29555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:08.308588 29555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:08.308612 29555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:02:08.309981 29555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:08.310240 29555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:08.310563 29555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:08.315621 29566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.315622 29568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.315702 29562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:08.316056 29555 server_base.cc:1034] running on GCE node
I20260808 21:02:08.316314 29555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:08.316560 29555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:08.317716 29555 hybrid_clock.cc:648] HybridClock initialized: now 1786222928317700 us; error 31 us; skew 500 ppm
I20260808 21:02:08.319084 29555 webserver.cc:460] Webserver started at http://127.14.146.193:33691/ using document root <none> and password file <none>
I20260808 21:02:08.319350 29555 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:08.319422 29555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:08.319597 29555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:08.320756 29555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "c83d4868871144be8471391ec0415251"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "14ef70c6b2eefdc2a6d0899ae779ec66"
server_key_iv: "8d56ca61ba7124c66edfd1e802e6a1d0"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.321128 29555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "c83d4868871144be8471391ec0415251"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "14ef70c6b2eefdc2a6d0899ae779ec66"
server_key_iv: "8d56ca61ba7124c66edfd1e802e6a1d0"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.322499 29555 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:02:08.323307 29578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.323467 29555 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:02:08.323565 29555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "c83d4868871144be8471391ec0415251"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "14ef70c6b2eefdc2a6d0899ae779ec66"
server_key_iv: "8d56ca61ba7124c66edfd1e802e6a1d0"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.323623 29555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:08.361498 29555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:08.361804 29555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:08.361912 29555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:08.362105 29555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:08.362493 29555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:08.362541 29555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.362565 29555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:08.362617 29555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.368852 29555 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:40509
I20260808 21:02:08.368919 29756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:40509 every 8 connection(s)
I20260808 21:02:08.369261 29555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:02:08.374639 29521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.370070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:60101 (local address 127.14.146.254:36549)
0808 21:02:08.370161 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:08.370163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:08.370374 (+ 211us) server_negotiation.cc:407] Connection header received
0808 21:02:08.370882 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:08.370883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:08.370898 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:08.370951 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:08.371601 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.372130 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.373152 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.373395 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.373463 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:08.374385 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:08.374386 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:08.374386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:02:08.374390 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:08.374403 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:02:08.374407 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:08.374482 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:08.374541 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 21:02:08.374574 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 21:02:08.374920 29760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.370043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:36549 (local address 127.14.146.193:60101)
0808 21:02:08.370255 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:08.370289 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:08.370796 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:08.371011 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:08.371014 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:08.371022 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:08.371527 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:08.371531 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.372215 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.372216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:08.373056 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:08.373058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.373485 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.373486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:08.373603 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:08.374255 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:02:08.374256 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:08.374285 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:02:08.374309 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:08.374481 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:08.374483 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:08.374486 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:02:08.374533 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 21:02:08.374614 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
I20260808 21:02:08.375449 29757 heartbeater.cc:347] Connected to a master server at 127.14.146.254:36549
I20260808 21:02:08.375566 29757 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:08.375767 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 29555
I20260808 21:02:08.375813 29757 heartbeater.cc:511] Master 127.14.146.254:36549 requested a full tablet report, sending...
I20260808 21:02:08.375891 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:02:08.376128 14923 external_mini_cluster.cc:1428] Setting key 3ec55aec98c4d7e88cfaa3b0cd53c64c
I20260808 21:02:08.376435 29469 ts_manager.cc:194] Registered new tserver with Master: c83d4868871144be8471391ec0415251 (127.14.146.193:40509)
I20260808 21:02:08.377115 29469 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.193:60101
I20260808 21:02:08.377206 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36549
--builtin_ntp_servers=127.14.146.212:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 21:02:08.460604 29761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:08.460831 29761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:08.460853 29761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:08.461941 29761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:08.461971 29761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:08.461994 29761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:02:08.463258 29761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:08.463450 29761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:08.463706 29761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:08.468855 29768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.468855 29772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.468884 29769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:08.469120 29761 server_base.cc:1034] running on GCE node
I20260808 21:02:08.469470 29761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:08.469759 29761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:08.470934 29761 hybrid_clock.cc:648] HybridClock initialized: now 1786222928470928 us; error 37 us; skew 500 ppm
I20260808 21:02:08.474090 29761 webserver.cc:460] Webserver started at http://127.14.146.194:34187/ using document root <none> and password file <none>
I20260808 21:02:08.474362 29761 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:08.474435 29761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:08.474603 29761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:08.475848 29761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "23caa4a6e6da472db52e618d70c0dce1"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "f23d0f83fee9266657d9e5a0d5ad50e3"
server_key_iv: "09cb9ec5e306affa752d0021eecdfaf9"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.476276 29761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "23caa4a6e6da472db52e618d70c0dce1"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "f23d0f83fee9266657d9e5a0d5ad50e3"
server_key_iv: "09cb9ec5e306affa752d0021eecdfaf9"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.477650 29761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:02:08.478437 29780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.478633 29761 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:02:08.478752 29761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "23caa4a6e6da472db52e618d70c0dce1"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "f23d0f83fee9266657d9e5a0d5ad50e3"
server_key_iv: "09cb9ec5e306affa752d0021eecdfaf9"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.478828 29761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:08.499547 29761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:08.499951 29761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:08.500144 29761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:08.500406 29761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:08.500779 29761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:08.500844 29761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.500890 29761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:08.500918 29761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.506923 29761 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:46221
I20260808 21:02:08.506978 29942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:46221 every 8 connection(s)
I20260808 21:02:08.507319 29761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:02:08.512784 29521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.508100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:34217 (local address 127.14.146.254:36549)
0808 21:02:08.508155 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:08.508157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:08.508424 (+ 267us) server_negotiation.cc:407] Connection header received
0808 21:02:08.508971 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:08.508972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:08.508987 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:08.509052 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:08.509755 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.510267 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.511284 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.511495 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.511584 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:08.512469 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:08.512470 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:08.512471 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:02:08.512475 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:08.512491 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:02:08.512495 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:08.512574 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:08.512673 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 21:02:08.512701 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:02:08.513048 29945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.508040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:36549 (local address 127.14.146.194:34217)
0808 21:02:08.508292 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:08.508326 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:08.508860 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:08.509127 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:08.509131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:08.509139 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:08.509650 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:08.509655 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.510370 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.510371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:08.511186 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:08.511189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.511595 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.511596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:08.511734 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:08.512322 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:02:08.512322 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:08.512351 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:02:08.512374 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:08.512578 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:08.512584 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:08.512588 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:02:08.512673 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:02:08.512791 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":91,"threads_started":1}
I20260808 21:02:08.513550 29943 heartbeater.cc:347] Connected to a master server at 127.14.146.254:36549
I20260808 21:02:08.513654 29943 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:08.513865 29943 heartbeater.cc:511] Master 127.14.146.254:36549 requested a full tablet report, sending...
I20260808 21:02:08.514264 29469 ts_manager.cc:194] Registered new tserver with Master: 23caa4a6e6da472db52e618d70c0dce1 (127.14.146.194:46221)
I20260808 21:02:08.514328 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 29761
I20260808 21:02:08.514410 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:02:08.514605 14923 external_mini_cluster.cc:1428] Setting key d81725a9d4c30c4c7df3cf8aff877ac9
I20260808 21:02:08.514776 29469 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.194:34217
I20260808 21:02:08.515563 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36549
--builtin_ntp_servers=127.14.146.212:34691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 21:02:08.599838 29946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:08.600167 29946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:08.600214 29946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:08.601318 29946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:08.601351 29946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:08.601375 29946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:02:08.602629 29946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:36549
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:08.602831 29946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:08.603082 29946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:08.608517 29954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.608596 29959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.608525 29955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:08.608592 29946 server_base.cc:1034] running on GCE node
I20260808 21:02:08.609005 29946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:08.609273 29946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:08.610424 29946 hybrid_clock.cc:648] HybridClock initialized: now 1786222928610402 us; error 37 us; skew 500 ppm
I20260808 21:02:08.611815 29946 webserver.cc:460] Webserver started at http://127.14.146.195:33909/ using document root <none> and password file <none>
I20260808 21:02:08.612150 29946 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:08.612207 29946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:08.612352 29946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:08.613464 29946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "c5483c11c25c479f8721a5bc608856b5"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "40fae0dc2dfc747407d3aac0c3c7ef2b"
server_key_iv: "d36b071c2cc1a4864d45434abf5f2cc8"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.613847 29946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "c5483c11c25c479f8721a5bc608856b5"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "40fae0dc2dfc747407d3aac0c3c7ef2b"
server_key_iv: "d36b071c2cc1a4864d45434abf5f2cc8"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.615150 29946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:02:08.615882 29971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.616091 29946 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:02:08.616204 29946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "c5483c11c25c479f8721a5bc608856b5"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "40fae0dc2dfc747407d3aac0c3c7ef2b"
server_key_iv: "d36b071c2cc1a4864d45434abf5f2cc8"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.616288 29946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:08.622960 29946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:08.623226 29946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:08.623369 29946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:08.623581 29946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:08.623889 29946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:08.623943 29946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.623982 29946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:08.624010 29946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.629840 29946 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:41759
I20260808 21:02:08.629889 30132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:41759 every 8 connection(s)
I20260808 21:02:08.630185 29946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:02:08.631443 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 29946
I20260808 21:02:08.631539 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:02:08.631744 14923 external_mini_cluster.cc:1428] Setting key 6ad0caf607d65e5e2df980eae9edc501
I20260808 21:02:08.636330 29521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.630898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:50815 (local address 127.14.146.254:36549)
0808 21:02:08.631044 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:08.631046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:08.631323 (+ 277us) server_negotiation.cc:407] Connection header received
0808 21:02:08.632083 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:08.632084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:08.632098 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:08.632179 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:08.633207 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.633996 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.634984 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.635206 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.635295 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:08.636027 (+ 732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:08.636028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:08.636029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:02:08.636033 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:08.636049 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:02:08.636053 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:08.636154 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:08.636226 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 21:02:08.636252 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 21:02:08.636547 30139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.630884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:36549 (local address 127.14.146.195:50815)
0808 21:02:08.631162 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:08.631213 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:08.631899 (+ 686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:08.632321 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:08.632325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:08.632337 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:08.633098 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:08.633104 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.634096 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.634097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:08.634891 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:08.634893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:08.635304 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:08.635306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:08.635444 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:08.635892 (+ 448us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:02:08.635892 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:08.635919 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:02:08.635940 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:08.636153 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:08.636159 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:08.636162 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:02:08.636229 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 21:02:08.636326 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":109,"threads_started":1}
I20260808 21:02:08.637041 30136 heartbeater.cc:347] Connected to a master server at 127.14.146.254:36549
I20260808 21:02:08.637116 30136 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:08.637326 30136 heartbeater.cc:511] Master 127.14.146.254:36549 requested a full tablet report, sending...
I20260808 21:02:08.637701 29469 ts_manager.cc:194] Registered new tserver with Master: c5483c11c25c479f8721a5bc608856b5 (127.14.146.195:41759)
I20260808 21:02:08.638091 29469 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.195:50815
I20260808 21:02:08.643555 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 21:02:08.645525 29521 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:08.644981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53594 (local address 127.14.146.254:36549)
0808 21:02:08.645064 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:08.645066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:08.645185 (+ 119us) server_negotiation.cc:407] Connection header received
0808 21:02:08.645250 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:08.645250 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:08.645261 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:08.645332 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:08.645480 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53594: BlockingRecv error: recv got EOF from 127.0.0.1:53594 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:02:08.645680 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 29555
I20260808 21:02:08.661685 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 29761
I20260808 21:02:08.675190 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 29946
I20260808 21:02:08.685470 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 29423
2026-08-08T21:02:08Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (677 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T21:02:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:02:08Z Disabled control of system clock
I20260808 21:02:08.717615 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:33197
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:33525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:33197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 21:02:08.805289 30150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:08.805497 30150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:08.805519 30150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:08.806676 30150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:02:08.806720 30150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:08.806732 30150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:08.806746 30150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:02:08.806783 30150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:02:08.808269 30150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:33525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:33197
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:33197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:08.808525 30150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:08.808861 30150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:08.813890 30156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.813912 30155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.813926 30161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:08.814119 30150 server_base.cc:1034] running on GCE node
I20260808 21:02:08.814426 30150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:08.814724 30150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:08.815876 30150 hybrid_clock.cc:648] HybridClock initialized: now 1786222928815868 us; error 38 us; skew 500 ppm
I20260808 21:02:08.817305 30150 webserver.cc:460] Webserver started at http://127.14.146.254:40625/ using document root <none> and password file <none>
I20260808 21:02:08.817569 30150 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:08.817639 30150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:08.817792 30150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:08.818894 30150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "db5336f3ce8340e084337944fc73ec8e"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "b5ecc8ea31c14863b0055f421a87db6a"
server_key_iv: "e0749f57ccbdf54b4c9758f1ce44d2ba"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.819279 30150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "db5336f3ce8340e084337944fc73ec8e"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "b5ecc8ea31c14863b0055f421a87db6a"
server_key_iv: "e0749f57ccbdf54b4c9758f1ce44d2ba"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.820674 30150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:02:08.821394 30167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.821570 30150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:02:08.821663 30150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "db5336f3ce8340e084337944fc73ec8e"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "b5ecc8ea31c14863b0055f421a87db6a"
server_key_iv: "e0749f57ccbdf54b4c9758f1ce44d2ba"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.821743 30150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:08.825232 30150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:08.825496 30150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:08.825641 30150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:08.829646 30150 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:33197
I20260808 21:02:08.829677 30243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:33197 every 8 connection(s)
I20260808 21:02:08.830021 30150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:02:08.830761 30244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:08.833627 30244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e: Bootstrap starting.
I20260808 21:02:08.834226 30244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:08.834542 30244 log.cc:824] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:08.835235 30244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e: No bootstrap required, opened a new log
I20260808 21:02:08.836925 30244 raft_consensus.cc:348] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db5336f3ce8340e084337944fc73ec8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33197 } }
I20260808 21:02:08.837061 30244 raft_consensus.cc:374] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:08.837106 30244 raft_consensus.cc:729] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db5336f3ce8340e084337944fc73ec8e, State: Initialized, Role: FOLLOWER
I20260808 21:02:08.837265 30244 consensus_queue.cc:260] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db5336f3ce8340e084337944fc73ec8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33197 } }
I20260808 21:02:08.837352 30244 raft_consensus.cc:388] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:02:08.837404 30244 raft_consensus.cc:482] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:02:08.837452 30244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:08.837990 30244 raft_consensus.cc:504] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db5336f3ce8340e084337944fc73ec8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33197 } }
I20260808 21:02:08.838104 30244 leader_election.cc:302] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db5336f3ce8340e084337944fc73ec8e; no voters:
I20260808 21:02:08.838290 30244 leader_election.cc:288] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:02:08.838322 30247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:02:08.838382 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 30150
I20260808 21:02:08.838449 30247 raft_consensus.cc:686] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [term 1 LEADER]: Becoming Leader. State: Replica: db5336f3ce8340e084337944fc73ec8e, State: Running, Role: LEADER
I20260808 21:02:08.838476 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:02:08.838565 30244 sys_catalog.cc:564] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:02:08.838614 30247 consensus_queue.cc:237] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db5336f3ce8340e084337944fc73ec8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33197 } }
I20260808 21:02:08.838666 14923 external_mini_cluster.cc:1428] Setting key 9fc6e2c01beb62499a2f756830adf140
I20260808 21:02:08.838954 30248 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db5336f3ce8340e084337944fc73ec8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db5336f3ce8340e084337944fc73ec8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33197 } } }
I20260808 21:02:08.839043 30248 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [sys.catalog]: This master's current role is: LEADER
I20260808 21:02:08.839294 30249 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5336f3ce8340e084337944fc73ec8e. Latest consensus state: current_term: 1 leader_uuid: "db5336f3ce8340e084337944fc73ec8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db5336f3ce8340e084337944fc73ec8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33197 } } }
I20260808 21:02:08.839398 30249 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e [sys.catalog]: This master's current role is: LEADER
I20260808 21:02:08.839872 30256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:02:08.840456 30256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:02:08.842092 30263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.839535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34752 (local address 127.14.146.254:33197)
0808 21:02:08.840272 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:08.840280 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:08.840311 (+ 31us) server_negotiation.cc:407] Connection header received
0808 21:02:08.840430 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:08.840437 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:08.840486 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:08.840988 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:08.841523 (+ 535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:08.841526 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:08.841526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:02:08.841530 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:08.841571 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:02:08.841586 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:08.841821 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:08.841856 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 21:02:08.841920 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":72,"threads_started":1}
I20260808 21:02:08.842222 30256 catalog_manager.cc:1347] Generated new cluster ID: b508aceac07744a896cf253f84bec589
I20260808 21:02:08.842344 30256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:02:08.875313 30256 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:02:08.875524 30256 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:02:08.883697 30256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db5336f3ce8340e084337944fc73ec8e: Generated new TSK 0
I20260808 21:02:08.883905 30256 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:02:08.887356 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33197
--builtin_ntp_servers=127.14.146.212:33525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 21:02:08.971647 30277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:08.971882 30277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:08.971921 30277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:08.973167 30277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:08.973239 30277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:08.973285 30277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:02:08.974653 30277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:33525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:08.974918 30277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:08.975219 30277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:08.980556 30288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.980587 30285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:08.980557 30286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:08.980794 30277 server_base.cc:1034] running on GCE node
I20260808 21:02:08.981015 30277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:08.981225 30277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:08.982404 30277 hybrid_clock.cc:648] HybridClock initialized: now 1786222928982391 us; error 29 us; skew 500 ppm
I20260808 21:02:08.983755 30277 webserver.cc:460] Webserver started at http://127.14.146.193:35063/ using document root <none> and password file <none>
I20260808 21:02:08.984002 30277 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:08.984050 30277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:08.984273 30277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:08.985358 30277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "93a1f565a01442338429cdfd33ce1ab6"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "5379d6581dd23f7f138e64004f010545"
server_key_iv: "f334efe594665d61f4e2b076f3064f71"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.985730 30277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "93a1f565a01442338429cdfd33ce1ab6"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "5379d6581dd23f7f138e64004f010545"
server_key_iv: "f334efe594665d61f4e2b076f3064f71"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.987049 30277 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:02:08.987753 30299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.987932 30277 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:02:08.988040 30277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "93a1f565a01442338429cdfd33ce1ab6"
format_stamp: "Formatted at 2026-08-08 21:02:08 on dist-test-slave-t3q3"
server_key: "5379d6581dd23f7f138e64004f010545"
server_key_iv: "f334efe594665d61f4e2b076f3064f71"
server_key_version: "encryptionkey@0"
I20260808 21:02:08.988175 30277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:08.991389 30277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:08.991650 30277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:08.991802 30277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:08.992010 30277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:08.992345 30277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:08.992403 30277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.992447 30277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:08.992475 30277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:08.998083 30277 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:46107
I20260808 21:02:08.998158 30467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:46107 every 8 connection(s)
I20260808 21:02:08.998485 30277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:02:09.001576 30263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.999234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:56793 (local address 127.14.146.254:33197)
0808 21:02:08.999297 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:08.999300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:08.999491 (+ 191us) server_negotiation.cc:407] Connection header received
0808 21:02:08.999918 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:08.999918 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:08.999924 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:08.999984 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:09.001337 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:09.001338 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:09.001338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:02:09.001342 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:09.001359 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:02:09.001364 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:09.001419 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:09.001506 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 21:02:09.001520 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 21:02:09.001744 30470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:08.999179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:33197 (local address 127.14.146.193:56793)
0808 21:02:08.999365 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:08.999403 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:08.999837 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:09.000112 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:09.000116 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:09.000125 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:09.001184 (+ 1059us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:02:09.001185 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:09.001221 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:02:09.001250 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:09.001429 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:09.001435 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:09.001437 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:02:09.001497 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 21:02:09.001547 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260808 21:02:09.002264 30468 heartbeater.cc:347] Connected to a master server at 127.14.146.254:33197
I20260808 21:02:09.002368 30468 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:09.002517 30468 heartbeater.cc:511] Master 127.14.146.254:33197 requested a full tablet report, sending...
I20260808 21:02:09.003034 30192 ts_manager.cc:194] Registered new tserver with Master: 93a1f565a01442338429cdfd33ce1ab6 (127.14.146.193:46107)
I20260808 21:02:09.003469 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 30277
I20260808 21:02:09.003563 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:02:09.003787 14923 external_mini_cluster.cc:1428] Setting key 7953fc7237f8155539a44e2a652b2f6f
I20260808 21:02:09.004714 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33197
--builtin_ntp_servers=127.14.146.212:33525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 21:02:09.087764 30474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:09.087975 30474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:09.087997 30474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:09.089192 30474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:09.089236 30474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:09.089262 30474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:02:09.090603 30474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:33525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:09.090806 30474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:09.091060 30474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:09.096186 30483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:09.096185 30480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:09.096195 30481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:09.096465 30474 server_base.cc:1034] running on GCE node
I20260808 21:02:09.096681 30474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:09.096872 30474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:09.098016 30474 hybrid_clock.cc:648] HybridClock initialized: now 1786222929098006 us; error 31 us; skew 500 ppm
I20260808 21:02:09.099232 30474 webserver.cc:460] Webserver started at http://127.14.146.194:42697/ using document root <none> and password file <none>
I20260808 21:02:09.099491 30474 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:09.099538 30474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:09.099717 30474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:09.100828 30474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "b73c4c343a634a59995c1b51ba1fa59a"
format_stamp: "Formatted at 2026-08-08 21:02:09 on dist-test-slave-t3q3"
server_key: "fd567a25014b9d19d7abb8158b4c0e08"
server_key_iv: "dc7f15266708a6af7ee132df944e7c84"
server_key_version: "encryptionkey@0"
I20260808 21:02:09.101193 30474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "b73c4c343a634a59995c1b51ba1fa59a"
format_stamp: "Formatted at 2026-08-08 21:02:09 on dist-test-slave-t3q3"
server_key: "fd567a25014b9d19d7abb8158b4c0e08"
server_key_iv: "dc7f15266708a6af7ee132df944e7c84"
server_key_version: "encryptionkey@0"
I20260808 21:02:09.102490 30474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:02:09.103193 30490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:09.103368 30474 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:02:09.103475 30474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "b73c4c343a634a59995c1b51ba1fa59a"
format_stamp: "Formatted at 2026-08-08 21:02:09 on dist-test-slave-t3q3"
server_key: "fd567a25014b9d19d7abb8158b4c0e08"
server_key_iv: "dc7f15266708a6af7ee132df944e7c84"
server_key_version: "encryptionkey@0"
I20260808 21:02:09.103557 30474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:09.106940 30474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:09.107193 30474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:09.107349 30474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:09.107555 30474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:09.107862 30474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:09.107918 30474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:09.107955 30474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:09.107985 30474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:09.114048 30474 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:44881
I20260808 21:02:09.114097 30660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:44881 every 8 connection(s)
I20260808 21:02:09.114436 30474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:02:09.117293 30263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:09.115178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:41059 (local address 127.14.146.254:33197)
0808 21:02:09.115250 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:09.115252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:09.115481 (+ 229us) server_negotiation.cc:407] Connection header received
0808 21:02:09.115912 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:09.115914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:09.115919 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:09.115971 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:09.117099 (+ 1128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:09.117100 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:09.117100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:02:09.117104 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:09.117120 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:02:09.117124 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:09.117180 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:09.117228 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 21:02:09.117241 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 21:02:09.117483 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:09.115175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:33197 (local address 127.14.146.194:41059)
0808 21:02:09.115364 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:09.115396 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:09.115832 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:09.116023 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:09.116026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:09.116034 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:09.116960 (+ 926us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:02:09.116961 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:09.116988 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:02:09.117016 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:09.117179 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:09.117181 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:09.117184 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:02:09.117234 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 21:02:09.117279 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260808 21:02:09.117944 30666 heartbeater.cc:347] Connected to a master server at 127.14.146.254:33197
I20260808 21:02:09.118033 30666 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:09.118144 30666 heartbeater.cc:511] Master 127.14.146.254:33197 requested a full tablet report, sending...
I20260808 21:02:09.118479 30192 ts_manager.cc:194] Registered new tserver with Master: b73c4c343a634a59995c1b51ba1fa59a (127.14.146.194:44881)
I20260808 21:02:09.120198 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 30474
I20260808 21:02:09.120302 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:02:09.120505 14923 external_mini_cluster.cc:1428] Setting key d77c500f2b61b733fd81923fa1662422
I20260808 21:02:09.121382 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33197
--builtin_ntp_servers=127.14.146.212:33525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 21:02:09.204964 30669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:09.205173 30669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:09.205194 30669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:09.206398 30669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:09.206437 30669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:09.206483 30669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:02:09.207880 30669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:33525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:09.208163 30669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:09.208483 30669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:09.213533 30682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:09.213601 30679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:09.213569 30680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:09.213757 30669 server_base.cc:1034] running on GCE node
I20260808 21:02:09.213945 30669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:09.214187 30669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:09.215330 30669 hybrid_clock.cc:648] HybridClock initialized: now 1786222929215323 us; error 34 us; skew 500 ppm
I20260808 21:02:09.216701 30669 webserver.cc:460] Webserver started at http://127.14.146.195:43723/ using document root <none> and password file <none>
I20260808 21:02:09.216961 30669 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:09.217034 30669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:09.217257 30669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:09.218319 30669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "5ea9d7dbe0744416bd564dd841ab1395"
format_stamp: "Formatted at 2026-08-08 21:02:09 on dist-test-slave-t3q3"
server_key: "123a6dd079e2cacf47de0dc51d2d5ca8"
server_key_iv: "c1e138da56cf6b6601542245253ec57a"
server_key_version: "encryptionkey@0"
I20260808 21:02:09.218679 30669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "5ea9d7dbe0744416bd564dd841ab1395"
format_stamp: "Formatted at 2026-08-08 21:02:09 on dist-test-slave-t3q3"
server_key: "123a6dd079e2cacf47de0dc51d2d5ca8"
server_key_iv: "c1e138da56cf6b6601542245253ec57a"
server_key_version: "encryptionkey@0"
I20260808 21:02:09.219996 30669 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 21:02:09.220747 30694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:09.220916 30669 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:02:09.221024 30669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "5ea9d7dbe0744416bd564dd841ab1395"
format_stamp: "Formatted at 2026-08-08 21:02:09 on dist-test-slave-t3q3"
server_key: "123a6dd079e2cacf47de0dc51d2d5ca8"
server_key_iv: "c1e138da56cf6b6601542245253ec57a"
server_key_version: "encryptionkey@0"
I20260808 21:02:09.221100 30669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:09.224499 30669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:09.224758 30669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:09.224900 30669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:09.225107 30669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:09.225411 30669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:09.225466 30669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:09.225507 30669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:09.225534 30669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:09.231227 30669 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:35943
I20260808 21:02:09.231262 30856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:35943 every 8 connection(s)
I20260808 21:02:09.231583 30669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:02:09.234360 30263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:09.232335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:44915 (local address 127.14.146.254:33197)
0808 21:02:09.232380 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:09.232382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:09.232584 (+ 202us) server_negotiation.cc:407] Connection header received
0808 21:02:09.233043 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:09.233044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:09.233050 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:09.233101 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:09.234176 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:09.234178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:09.234178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:02:09.234181 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:09.234197 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:02:09.234203 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:09.234249 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:09.234295 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 21:02:09.234307 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:02:09.234576 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:09.232304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:33197 (local address 127.14.146.195:44915)
0808 21:02:09.232480 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:09.232513 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:09.232948 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:09.233153 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:09.233156 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:09.233165 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:09.234034 (+ 869us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:02:09.234035 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:09.234063 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:02:09.234090 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:09.234247 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:09.234249 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:09.234251 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:02:09.234302 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 21:02:09.234347 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260808 21:02:09.235082 30857 heartbeater.cc:347] Connected to a master server at 127.14.146.254:33197
I20260808 21:02:09.235170 30857 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:09.235285 30857 heartbeater.cc:511] Master 127.14.146.254:33197 requested a full tablet report, sending...
I20260808 21:02:09.235636 30192 ts_manager.cc:194] Registered new tserver with Master: 5ea9d7dbe0744416bd564dd841ab1395 (127.14.146.195:35943)
I20260808 21:02:09.237119 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 30669
I20260808 21:02:09.237200 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:02:09.237344 14923 external_mini_cluster.cc:1428] Setting key 381047fa53c8e0e56df427ef37077682
I20260808 21:02:09.237984 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 21:02:09.239961 30263 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:02:09.239403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34760 (local address 127.14.146.254:33197)
0808 21:02:09.239439 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:09.239440 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:09.239586 (+ 146us) server_negotiation.cc:407] Connection header received
0808 21:02:09.239690 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:09.239691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:09.239695 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:09.239757 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:09.239887 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34760: BlockingRecv error: recv got EOF from 127.0.0.1:34760 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:02:09.240065 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 30277
I20260808 21:02:09.263497 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 30474
I20260808 21:02:09.276297 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 30669
I20260808 21:02:09.292896 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 30150
2026-08-08T21:02:09Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (606 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:02:09 dist-test-slave-t3q3 krb5kdc[30872](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:02:09 dist-test-slave-t3q3 krb5kdc[30872](info): set up 2 sockets
Aug 08 21:02:09 dist-test-slave-t3q3 krb5kdc[30872](info): commencing operation
krb5kdc: starting...
W20260808 21:02:10.546381 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:02:10 dist-test-slave-t3q3 krb5kdc[30872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:02:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:02:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:02:10.670748 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:41683
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:41683
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:02:10.756507 30891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:10.756762 30891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:10.756801 30891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:10.757946 30891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:02:10.758013 30891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:10.758039 30891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:10.758059 30891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:02:10.758092 30891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:02:10.759594 30891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:41683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:41683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:10.759878 30891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:10.760139 30891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:10.765225 30902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:10.765221 30900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:10.765252 30898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:10.765441 30891 server_base.cc:1034] running on GCE node
I20260808 21:02:10.765826 30891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:10.766134 30891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:10.767284 30891 hybrid_clock.cc:648] HybridClock initialized: now 1786222930767258 us; error 40 us; skew 500 ppm
Aug 08 21:02:10 dist-test-slave-t3q3 krb5kdc[30872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:02:10.769928 30891 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:02:10.770393 30891 webserver.cc:460] Webserver started at http://127.14.146.254:39899/ using document root <none> and password file <none>
I20260808 21:02:10.770648 30891 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:10.770721 30891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:10.770874 30891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:10.771951 30891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "93d89b8ccdb142db98d6ea44d65ca0d8"
format_stamp: "Formatted at 2026-08-08 21:02:10 on dist-test-slave-t3q3"
server_key: "b6255562861caa69f2b982dbf33a29fd"
server_key_iv: "e1ce17d8c26388bf8b75aced047deb3b"
server_key_version: "encryptionkey@0"
I20260808 21:02:10.772394 30891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "93d89b8ccdb142db98d6ea44d65ca0d8"
format_stamp: "Formatted at 2026-08-08 21:02:10 on dist-test-slave-t3q3"
server_key: "b6255562861caa69f2b982dbf33a29fd"
server_key_iv: "e1ce17d8c26388bf8b75aced047deb3b"
server_key_version: "encryptionkey@0"
I20260808 21:02:10.773774 30891 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:02:10.774559 30915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:10.774752 30891 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:02:10.774864 30891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "93d89b8ccdb142db98d6ea44d65ca0d8"
format_stamp: "Formatted at 2026-08-08 21:02:10 on dist-test-slave-t3q3"
server_key: "b6255562861caa69f2b982dbf33a29fd"
server_key_iv: "e1ce17d8c26388bf8b75aced047deb3b"
server_key_version: "encryptionkey@0"
I20260808 21:02:10.774941 30891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:10.791180 30891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:10.793527 30891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:10.793705 30891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:10.798913 30891 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:41683
I20260808 21:02:10.798993 30985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:41683 every 8 connection(s)
I20260808 21:02:10.799463 30891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:02:10.800905 30986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:10.803392 30986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8: Bootstrap starting.
I20260808 21:02:10.804098 30986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:10.804409 30986 log.cc:824] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:10.805783 30986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8: No bootstrap required, opened a new log
I20260808 21:02:10.806430 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 30891
I20260808 21:02:10.806535 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:02:10.806783 14923 external_mini_cluster.cc:1428] Setting key 9c0f7f48ac368043d893a8f1d91003d7
I20260808 21:02:10.808527 30986 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d89b8ccdb142db98d6ea44d65ca0d8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } }
I20260808 21:02:10.808708 30986 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:10.808780 30986 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93d89b8ccdb142db98d6ea44d65ca0d8, State: Initialized, Role: FOLLOWER
I20260808 21:02:10.808934 30986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d89b8ccdb142db98d6ea44d65ca0d8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } }
I20260808 21:02:10.809041 30986 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:02:10.809087 30986 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:02:10.809140 30986 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:10.810096 30986 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d89b8ccdb142db98d6ea44d65ca0d8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } }
I20260808 21:02:10.810226 30986 leader_election.cc:302] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93d89b8ccdb142db98d6ea44d65ca0d8; no voters:
I20260808 21:02:10.810444 30986 leader_election.cc:288] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:02:10.810464 30993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:02:10.810657 30993 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [term 1 LEADER]: Becoming Leader. State: Replica: 93d89b8ccdb142db98d6ea44d65ca0d8, State: Running, Role: LEADER
I20260808 21:02:10.810757 30993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d89b8ccdb142db98d6ea44d65ca0d8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } }
I20260808 21:02:10.810832 30986 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:02:10.811102 30993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93d89b8ccdb142db98d6ea44d65ca0d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d89b8ccdb142db98d6ea44d65ca0d8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } } }
I20260808 21:02:10.811265 30993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:02:10.811474 30993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93d89b8ccdb142db98d6ea44d65ca0d8. Latest consensus state: current_term: 1 leader_uuid: "93d89b8ccdb142db98d6ea44d65ca0d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93d89b8ccdb142db98d6ea44d65ca0d8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } } }
I20260808 21:02:10.811558 30993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8 [sys.catalog]: This master's current role is: LEADER
I20260808 21:02:10.812040 30999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:02:10.812645 30999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:02:10.814347 30999 catalog_manager.cc:1347] Generated new cluster ID: 0682717ee81d47aab2eb753a5542909a
I20260808 21:02:10.814402 30999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:02:10 dist-test-slave-t3q3 krb5kdc[30872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:02:10.819252 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:10.807552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44120 (local address 127.14.146.254:41683)
0808 21:02:10.807730 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:10.807741 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:10.807773 (+ 32us) server_negotiation.cc:407] Connection header received
0808 21:02:10.808500 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:10.808508 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:10.808565 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:10.808728 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:10.809476 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:10.810386 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:10.811484 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:10.812117 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:10.812263 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:10.815779 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:10.815783 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:10.815784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:10.815796 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:10.817636 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:10.818040 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:10.818043 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:10.818043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:10.818159 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:10.818392 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:10.818393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:10.818393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:10.818636 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:10.818832 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:10.818905 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 21:02:10.819060 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":87,"threads_started":1}
I20260808 21:02:10.826536 30999 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:02:10.827284 30999 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:02:10.838199 30999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8: Generated new TSK 0
I20260808 21:02:10.838424 30999 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:02:10.869290 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41683
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:02:10.968015 31022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:10.968230 31022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:10.968253 31022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:10.969404 31022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:10.969445 31022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:10.969472 31022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:02:10.970944 31022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:10.971203 31022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:10.971442 31022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:10.976593 31036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:10.976665 31022 server_base.cc:1034] running on GCE node
W20260808 21:02:10.976610 31033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:10.976610 31029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:10.977021 31022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:10.977295 31022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:10.978471 31022 hybrid_clock.cc:648] HybridClock initialized: now 1786222930978461 us; error 38 us; skew 500 ppm
Aug 08 21:02:10 dist-test-slave-t3q3 krb5kdc[30872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:02:10.981366 31022 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:02:10.981798 31022 webserver.cc:460] Webserver started at http://127.14.146.193:42269/ using document root <none> and password file <none>
I20260808 21:02:10.982053 31022 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:10.982131 31022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:10.982291 31022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:10.983376 31022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "efa8cc7837e94531b0b9bb6bbdc605af"
format_stamp: "Formatted at 2026-08-08 21:02:10 on dist-test-slave-t3q3"
server_key: "ef21aabf8e4bd98928e4eef94f4cc56b"
server_key_iv: "7a597b7640d8eed29739c59a49f2d47d"
server_key_version: "encryptionkey@0"
I20260808 21:02:10.983733 31022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "efa8cc7837e94531b0b9bb6bbdc605af"
format_stamp: "Formatted at 2026-08-08 21:02:10 on dist-test-slave-t3q3"
server_key: "ef21aabf8e4bd98928e4eef94f4cc56b"
server_key_iv: "7a597b7640d8eed29739c59a49f2d47d"
server_key_version: "encryptionkey@0"
I20260808 21:02:10.985153 31022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:02:10.985862 31045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:10.986035 31022 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:02:10.986140 31022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "efa8cc7837e94531b0b9bb6bbdc605af"
format_stamp: "Formatted at 2026-08-08 21:02:10 on dist-test-slave-t3q3"
server_key: "ef21aabf8e4bd98928e4eef94f4cc56b"
server_key_iv: "7a597b7640d8eed29739c59a49f2d47d"
server_key_version: "encryptionkey@0"
I20260808 21:02:10.986222 31022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:11.003517 31022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:11.005336 31022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:11.005498 31022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:11.005722 31022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:11.006047 31022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:11.006107 31022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:11.006138 31022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:11.006157 31022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:11.012236 31022 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:37021
I20260808 21:02:11.012313 31214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:37021 every 8 connection(s)
I20260808 21:02:11.012635 31022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:02:11.015632 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 31022
I20260808 21:02:11.015731 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:02:11.015911 14923 external_mini_cluster.cc:1428] Setting key c50b8095a461f3a302cec4d36566ef41
Aug 08 21:02:11 dist-test-slave-t3q3 krb5kdc[30872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222930, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:02:11.022776 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.013467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:53137 (local address 127.14.146.254:41683)
0808 21:02:11.013554 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.013557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.013722 (+ 165us) server_negotiation.cc:407] Connection header received
0808 21:02:11.014278 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.014279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.014290 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.014339 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:11.015234 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.016003 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.017157 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.017500 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.017576 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.019755 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:11.019756 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:11.019756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:11.019767 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:11.021314 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:11.021753 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:11.021755 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:11.021755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:11.021817 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:11.022097 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:11.022099 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:11.022099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:11.022221 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:11.022296 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.022583 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.022681 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 21:02:11.022953 31219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.013417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:41683 (local address 127.14.146.193:53137)
0808 21:02:11.013601 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.013636 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:11.014185 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:11.014400 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:11.014403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:11.014964 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:11.015156 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.015161 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.016124 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.016125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.017068 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.017071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.017596 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.017597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.017700 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.018267 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:11.018275 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:11.019655 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:11.021417 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:11.021426 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:11.021428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:11.021661 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:11.021888 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:11.021889 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:11.021889 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:11.022009 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:11.022301 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:11.022309 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:11.022445 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 21:02:11.022555 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 21:02:11.022714 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":105,"threads_started":1}
I20260808 21:02:11.023664 31215 heartbeater.cc:347] Connected to a master server at 127.14.146.254:41683
I20260808 21:02:11.023773 31215 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:11.023955 31215 heartbeater.cc:511] Master 127.14.146.254:41683 requested a full tablet report, sending...
I20260808 21:02:11.024631 30939 ts_manager.cc:194] Registered new tserver with Master: efa8cc7837e94531b0b9bb6bbdc605af (127.14.146.193:37021)
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:02:11.025573 30939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:53137
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:02:11.042809 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41683
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:02:11.125891 31223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:11.126086 31223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:11.126111 31223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:11.127226 31223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:11.127285 31223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:11.127328 31223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:02:11.129045 31223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:11.129468 31223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:11.129750 31223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:11.134790 31233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:11.134778 31234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:11.134792 31237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:11.135013 31223 server_base.cc:1034] running on GCE node
I20260808 21:02:11.135290 31223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:11.135504 31223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:11.136677 31223 hybrid_clock.cc:648] HybridClock initialized: now 1786222931136651 us; error 39 us; skew 500 ppm
Aug 08 21:02:11 dist-test-slave-t3q3 krb5kdc[30872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222931, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:02:11.139379 31223 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:02:11.139788 31223 webserver.cc:460] Webserver started at http://127.14.146.194:42793/ using document root <none> and password file <none>
I20260808 21:02:11.139993 31223 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:11.140043 31223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:11.140230 31223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:11.141245 31223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "b303c4191f4e41f29f3b09d0bfdb29fc"
format_stamp: "Formatted at 2026-08-08 21:02:11 on dist-test-slave-t3q3"
server_key: "95b81199fc46b2cd637775911f4caea8"
server_key_iv: "3c9b8155a2aeeaa31981e8eed140e332"
server_key_version: "encryptionkey@0"
I20260808 21:02:11.141570 31223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "b303c4191f4e41f29f3b09d0bfdb29fc"
format_stamp: "Formatted at 2026-08-08 21:02:11 on dist-test-slave-t3q3"
server_key: "95b81199fc46b2cd637775911f4caea8"
server_key_iv: "3c9b8155a2aeeaa31981e8eed140e332"
server_key_version: "encryptionkey@0"
I20260808 21:02:11.142866 31223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:02:11.143589 31252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:11.143800 31223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:02:11.143889 31223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "b303c4191f4e41f29f3b09d0bfdb29fc"
format_stamp: "Formatted at 2026-08-08 21:02:11 on dist-test-slave-t3q3"
server_key: "95b81199fc46b2cd637775911f4caea8"
server_key_iv: "3c9b8155a2aeeaa31981e8eed140e332"
server_key_version: "encryptionkey@0"
I20260808 21:02:11.143944 31223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:11.156344 31223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:11.158499 31223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:11.158617 31223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:11.158818 31223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:11.159091 31223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:11.159123 31223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:11.159144 31223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:11.159157 31223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:11.164862 31223 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:39061
I20260808 21:02:11.164943 31425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:39061 every 8 connection(s)
I20260808 21:02:11.165258 31223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:02:11.167976 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 31223
I20260808 21:02:11.168125 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:02:11.168339 14923 external_mini_cluster.cc:1428] Setting key bf923bb3d66c98e7495d5fbb35668482
Aug 08 21:02:11 dist-test-slave-t3q3 krb5kdc[30872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222931, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:02:11.175043 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.165984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:37969 (local address 127.14.146.254:41683)
0808 21:02:11.166044 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.166046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.166258 (+ 212us) server_negotiation.cc:407] Connection header received
0808 21:02:11.166711 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.166712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.166722 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.166810 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:11.167703 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.168352 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.169616 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.169817 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.169926 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.172191 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:11.172193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:11.172193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:11.172200 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:11.173625 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:11.174057 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:11.174059 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:11.174059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:11.174119 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:11.174375 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:11.174376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:11.174377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:11.174496 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:11.174569 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.174857 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.174951 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 21:02:11.175241 31430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.165960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:41683 (local address 127.14.146.194:37969)
0808 21:02:11.166134 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.166170 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:11.166628 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:11.166870 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:11.166873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:11.167433 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:11.167621 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.167625 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.168501 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.168502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.169503 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.169506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.169933 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.169934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.170069 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.170611 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:11.170620 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:11.172012 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:11.173727 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:11.173734 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:11.173736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:11.173963 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:11.174189 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:11.174190 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:11.174190 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:11.174304 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:11.174571 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:11.174578 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:11.174719 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 21:02:11.174823 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 21:02:11.174983 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260808 21:02:11.175726 31428 heartbeater.cc:347] Connected to a master server at 127.14.146.254:41683
I20260808 21:02:11.175822 31428 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:11.176028 31428 heartbeater.cc:511] Master 127.14.146.254:41683 requested a full tablet report, sending...
I20260808 21:02:11.176505 30939 ts_manager.cc:194] Registered new tserver with Master: b303c4191f4e41f29f3b09d0bfdb29fc (127.14.146.194:39061)
I20260808 21:02:11.177037 30939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:37969
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:02:11.195657 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41683
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:02:11.281486 31434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:11.281701 31434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:11.281728 31434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:11.282835 31434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:11.282871 31434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:11.282896 31434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:02:11.284376 31434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:41683
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:11.284574 31434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:11.284755 31434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:11.289829 31448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:11.289860 31444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:11.289803 31442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:11.290061 31434 server_base.cc:1034] running on GCE node
I20260808 21:02:11.290299 31434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:11.290585 31434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:11.291749 31434 hybrid_clock.cc:648] HybridClock initialized: now 1786222931291736 us; error 25 us; skew 500 ppm
Aug 08 21:02:11 dist-test-slave-t3q3 krb5kdc[30872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222931, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:02:11.294404 31434 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:02:11.294922 31434 webserver.cc:460] Webserver started at http://127.14.146.195:45747/ using document root <none> and password file <none>
I20260808 21:02:11.295187 31434 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:11.295258 31434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:11.295413 31434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:02:11.296546 31434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "0ddf28764fd944b298910160b7300cde"
format_stamp: "Formatted at 2026-08-08 21:02:11 on dist-test-slave-t3q3"
server_key: "27376c6bf01cb33812c6292c7b06c86f"
server_key_iv: "d9d087eaebb2effb36362400cc46baa5"
server_key_version: "encryptionkey@0"
I20260808 21:02:11.296916 31434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "0ddf28764fd944b298910160b7300cde"
format_stamp: "Formatted at 2026-08-08 21:02:11 on dist-test-slave-t3q3"
server_key: "27376c6bf01cb33812c6292c7b06c86f"
server_key_iv: "d9d087eaebb2effb36362400cc46baa5"
server_key_version: "encryptionkey@0"
I20260808 21:02:11.298282 31434 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:02:11.299081 31459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:11.299332 31434 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:02:11.299436 31434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "0ddf28764fd944b298910160b7300cde"
format_stamp: "Formatted at 2026-08-08 21:02:11 on dist-test-slave-t3q3"
server_key: "27376c6bf01cb33812c6292c7b06c86f"
server_key_iv: "d9d087eaebb2effb36362400cc46baa5"
server_key_version: "encryptionkey@0"
I20260808 21:02:11.299527 31434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:11.317875 31434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:11.320250 31434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:11.320422 31434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:11.320672 31434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:11.321003 31434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:11.321095 31434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:11.321142 31434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:11.321174 31434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:11.326838 31434 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:41063
I20260808 21:02:11.326902 31625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:41063 every 8 connection(s)
I20260808 21:02:11.327322 31434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:02:11.331638 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 31434
I20260808 21:02:11.331749 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:02:11.331934 14923 external_mini_cluster.cc:1428] Setting key 0d1d4641da36991238ec0306512ce245
Aug 08 21:02:11 dist-test-slave-t3q3 krb5kdc[30872](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222931, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:02:11.337039 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.328137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:59539 (local address 127.14.146.254:41683)
0808 21:02:11.328205 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.328207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.328442 (+ 235us) server_negotiation.cc:407] Connection header received
0808 21:02:11.328988 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.328990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.329002 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.329079 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:11.330035 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.330571 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.331590 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.331852 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.331921 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.334321 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:11.334323 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:11.334323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:11.334331 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:11.335573 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:11.336014 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:11.336015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:11.336016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:11.336113 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:11.336375 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:11.336376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:11.336376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:11.336500 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:11.336574 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.336862 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.336948 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 21:02:11.337251 31629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.328127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:41683 (local address 127.14.146.195:59539)
0808 21:02:11.328316 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.328354 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:11.328880 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:11.329157 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:11.329160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:11.329741 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:11.329935 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.329939 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.330673 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.330674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.331482 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.331484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.331931 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.331932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.332139 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.332628 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:11.332637 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:11.334222 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:11.335685 (+ 1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:11.335692 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:11.335694 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:11.335920 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:11.336183 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:11.336184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:11.336184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:11.336296 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:11.336577 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:11.336584 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:11.336725 (+ 141us) client_negotiation.cc:769] Sending connection context
0808 21:02:11.336839 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 21:02:11.336998 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":95,"threads_started":1}
I20260808 21:02:11.337759 31626 heartbeater.cc:347] Connected to a master server at 127.14.146.254:41683
I20260808 21:02:11.337860 31626 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:11.338001 31626 heartbeater.cc:511] Master 127.14.146.254:41683 requested a full tablet report, sending...
I20260808 21:02:11.338393 30939 ts_manager.cc:194] Registered new tserver with Master: 0ddf28764fd944b298910160b7300cde (127.14.146.195:41063)
I20260808 21:02:11.338740 30939 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:59539
I20260808 21:02:11.343930 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:02:11.351097 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.345377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44126 (local address 127.14.146.254:41683)
0808 21:02:11.345418 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.345420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.345546 (+ 126us) server_negotiation.cc:407] Connection header received
0808 21:02:11.345585 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.345586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.345594 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.345635 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:11.346186 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.346699 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.347388 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.347565 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.347614 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.349023 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:11.349024 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:11.349024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:11.349029 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:11.350188 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:11.350495 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:11.350495 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:11.350496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:11.350544 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:11.350683 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:11.350683 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:11.350683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:11.350813 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:11.350889 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.350982 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.351038 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:02:11.352846 30939 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:02:11.354423 30939 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:02:11.360920 31648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.356792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:39061 (local address 127.0.0.1:57680)
0808 21:02:11.356931 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.356968 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:11.357062 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:11.357536 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:11.357539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:11.357542 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:11.357607 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.357608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.358547 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.358549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.359579 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.359582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.360567 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.360568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.360666 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.360681 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 21:02:11.360753 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 21:02:11.360810 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":35,"thread_start_us":90,"threads_started":1}
I20260808 21:02:11.361116 31645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.357008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:37021 (local address 127.0.0.1:59768)
0808 21:02:11.357326 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.357333 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:11.357363 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:11.357637 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:11.357638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:11.357640 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:11.357679 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.357680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.358568 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.358570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.359971 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.359975 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.360918 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.360919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.360984 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.360990 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 21:02:11.361024 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 21:02:11.361061 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":67,"threads_started":1}
I20260808 21:02:11.361178 31649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.356899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57680 (local address 127.14.146.194:39061)
0808 21:02:11.357197 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.357204 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.357216 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:02:11.357397 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.357400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.357416 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.357517 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:11.357702 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.358429 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.359700 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.360404 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.360478 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.360531 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.361043 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.361084 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":94,"threads_started":1}
I20260808 21:02:11.361425 31652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.357138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59768 (local address 127.14.146.193:37021)
0808 21:02:11.357467 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.357471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.357478 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:02:11.357533 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.357535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.357551 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.357626 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:11.357723 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.358458 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.360090 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.360825 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.361236 (+ 411us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.361302 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.361333 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.361365 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":88,"threads_started":1}
I20260808 21:02:11.362082 31326 tablet_service.cc:1467] Processing CreateTablet for tablet ce68928244be41a8ad9966ed9ce414b6 (DEFAULT_TABLE table=test-table [id=3ac793b91dbe4bfa828facb2b8414760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:02:11.362133 31117 tablet_service.cc:1467] Processing CreateTablet for tablet ce68928244be41a8ad9966ed9ce414b6 (DEFAULT_TABLE table=test-table [id=3ac793b91dbe4bfa828facb2b8414760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:02:11.362444 31326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce68928244be41a8ad9966ed9ce414b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:11.362504 31117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce68928244be41a8ad9966ed9ce414b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:11.365298 31657 tablet_bootstrap.cc:492] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af: Bootstrap starting.
I20260808 21:02:11.365434 31656 tablet_bootstrap.cc:492] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Bootstrap starting.
I20260808 21:02:11.365938 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.356795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41063 (local address 127.0.0.1:34978)
0808 21:02:11.357146 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.357169 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:11.357224 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:11.358825 (+ 1601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:11.358826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:11.358829 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:11.358867 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.358868 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.360125 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.360126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.360803 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.360805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.365650 (+ 4845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.365651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.365731 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.365735 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:02:11.365801 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 21:02:11.365844 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":58,"threads_started":1}
I20260808 21:02:11.365969 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.357101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34978 (local address 127.14.146.195:41063)
0808 21:02:11.358658 (+ 1557us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.358663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.358672 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:02:11.358708 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.358710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.358724 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.358804 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:11.358957 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.359986 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.360897 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.365565 (+ 4668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.365645 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.365704 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.365834 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.365885 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1519,"thread_start_us":93,"threads_started":1}
I20260808 21:02:11.366039 31657 tablet_bootstrap.cc:654] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:11.366148 31656 tablet_bootstrap.cc:654] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:11.366603 31657 log.cc:824] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:11.366739 31656 log.cc:824] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:11.366691 31529 tablet_service.cc:1467] Processing CreateTablet for tablet ce68928244be41a8ad9966ed9ce414b6 (DEFAULT_TABLE table=test-table [id=3ac793b91dbe4bfa828facb2b8414760]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:02:11.367051 31529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce68928244be41a8ad9966ed9ce414b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:11.367512 31657 tablet_bootstrap.cc:492] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af: No bootstrap required, opened a new log
I20260808 21:02:11.367607 31657 ts_tablet_manager.cc:1397] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:02:11.368460 31656 tablet_bootstrap.cc:492] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: No bootstrap required, opened a new log
I20260808 21:02:11.368536 31656 ts_tablet_manager.cc:1397] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 21:02:11.369154 31657 raft_consensus.cc:348] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.369308 31657 raft_consensus.cc:374] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:11.369351 31657 raft_consensus.cc:729] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efa8cc7837e94531b0b9bb6bbdc605af, State: Initialized, Role: FOLLOWER
I20260808 21:02:11.369465 31657 consensus_queue.cc:260] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.369767 31657 ts_tablet_manager.cc:1428] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:02:11.369903 31215 heartbeater.cc:503] Master 127.14.146.254:41683 was elected leader, sending a full tablet report...
I20260808 21:02:11.370347 31663 tablet_bootstrap.cc:492] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Bootstrap starting.
I20260808 21:02:11.370566 31656 raft_consensus.cc:348] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.370766 31656 raft_consensus.cc:374] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:11.370818 31656 raft_consensus.cc:729] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b303c4191f4e41f29f3b09d0bfdb29fc, State: Initialized, Role: FOLLOWER
I20260808 21:02:11.370952 31656 consensus_queue.cc:260] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.371184 31663 tablet_bootstrap.cc:654] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:11.371260 31656 ts_tablet_manager.cc:1428] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:02:11.371272 31428 heartbeater.cc:503] Master 127.14.146.254:41683 was elected leader, sending a full tablet report...
I20260808 21:02:11.371752 31663 log.cc:824] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:11.372589 31663 tablet_bootstrap.cc:492] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: No bootstrap required, opened a new log
I20260808 21:02:11.372646 31663 ts_tablet_manager.cc:1397] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:02:11.373899 31663 raft_consensus.cc:348] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.374019 31663 raft_consensus.cc:374] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:11.374040 31663 raft_consensus.cc:729] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddf28764fd944b298910160b7300cde, State: Initialized, Role: FOLLOWER
I20260808 21:02:11.374155 31663 consensus_queue.cc:260] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.374410 31663 ts_tablet_manager.cc:1428] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:02:11.374449 31626 heartbeater.cc:503] Master 127.14.146.254:41683 was elected leader, sending a full tablet report...
W20260808 21:02:11.415932 31429 tablet.cc:2369] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:02:11.513414 31216 tablet.cc:2369] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:02:11.576665 31664 raft_consensus.cc:482] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:02:11.576793 31664 raft_consensus.cc:504] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.577198 31664 leader_election.cc:288] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddf28764fd944b298910160b7300cde (127.14.146.195:41063), efa8cc7837e94531b0b9bb6bbdc605af (127.14.146.193:37021)
W20260808 21:02:11.577909 31627 tablet.cc:2369] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:02:11.580216 31652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.577450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:57001 (local address 127.14.146.193:37021)
0808 21:02:11.577492 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.577494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.577524 (+ 30us) server_negotiation.cc:407] Connection header received
0808 21:02:11.577561 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.577562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.577575 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.577642 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:11.577857 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.578449 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.579427 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.579824 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.579883 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.579891 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.580094 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.580142 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:02:11.580219 31430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.577369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:37021 (local address 127.14.146.194:57001)
0808 21:02:11.577429 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.577441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:11.577487 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:11.577648 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:11.577649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:11.577651 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:11.577731 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.577733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.578537 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.578539 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.579338 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.579340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.579905 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.579906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.579992 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.579996 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:02:11.580050 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 21:02:11.580117 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":11}
I20260808 21:02:11.580297 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.577441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:37743 (local address 127.14.146.195:41063)
0808 21:02:11.577495 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.577497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.577625 (+ 128us) server_negotiation.cc:407] Connection header received
0808 21:02:11.577699 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.577699 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.577709 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.577785 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:11.577978 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.578527 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.579498 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.579911 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.579985 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.579993 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.580185 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.580227 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:02:11.580343 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.577385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41063 (local address 127.14.146.194:37743)
0808 21:02:11.577564 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.577574 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:11.577641 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:11.577818 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:11.577819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:11.577821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:11.577900 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.577901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.578610 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.578611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.579407 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:11.579410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.579994 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.579995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:11.580107 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.580112 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:02:11.580171 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 21:02:11.580206 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":132,"threads_started":1}
I20260808 21:02:11.580626 31148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce68928244be41a8ad9966ed9ce414b6" candidate_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" is_pre_election: true
I20260808 21:02:11.580624 31563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce68928244be41a8ad9966ed9ce414b6" candidate_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddf28764fd944b298910160b7300cde" is_pre_election: true
I20260808 21:02:11.580789 31563 raft_consensus.cc:2454] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b303c4191f4e41f29f3b09d0bfdb29fc in term 0.
I20260808 21:02:11.580789 31148 raft_consensus.cc:2454] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b303c4191f4e41f29f3b09d0bfdb29fc in term 0.
I20260808 21:02:11.581000 31259 leader_election.cc:302] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b303c4191f4e41f29f3b09d0bfdb29fc, efa8cc7837e94531b0b9bb6bbdc605af; no voters:
I20260808 21:02:11.581192 31664 raft_consensus.cc:2781] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:02:11.581252 31664 raft_consensus.cc:482] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:02:11.581277 31664 raft_consensus.cc:3037] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:11.581996 31664 raft_consensus.cc:504] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.582139 31664 leader_election.cc:288] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [CANDIDATE]: Term 1 election: Requested vote from peers 0ddf28764fd944b298910160b7300cde (127.14.146.195:41063), efa8cc7837e94531b0b9bb6bbdc605af (127.14.146.193:37021)
I20260808 21:02:11.582319 31148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce68928244be41a8ad9966ed9ce414b6" candidate_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efa8cc7837e94531b0b9bb6bbdc605af"
I20260808 21:02:11.582337 31563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce68928244be41a8ad9966ed9ce414b6" candidate_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddf28764fd944b298910160b7300cde"
I20260808 21:02:11.582417 31563 raft_consensus.cc:3037] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:11.582418 31148 raft_consensus.cc:3037] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:11.583351 31563 raft_consensus.cc:2454] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b303c4191f4e41f29f3b09d0bfdb29fc in term 1.
I20260808 21:02:11.583350 31148 raft_consensus.cc:2454] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b303c4191f4e41f29f3b09d0bfdb29fc in term 1.
I20260808 21:02:11.583591 31257 leader_election.cc:302] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddf28764fd944b298910160b7300cde, b303c4191f4e41f29f3b09d0bfdb29fc; no voters:
I20260808 21:02:11.583724 31664 raft_consensus.cc:2781] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:02:11.583940 31664 raft_consensus.cc:686] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 1 LEADER]: Becoming Leader. State: Replica: b303c4191f4e41f29f3b09d0bfdb29fc, State: Running, Role: LEADER
I20260808 21:02:11.584031 31664 consensus_queue.cc:237] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } }
I20260808 21:02:11.584955 30937 catalog_manager.cc:5495] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc reported cstate change: term changed from 0 to 1, leader changed from <none> to b303c4191f4e41f29f3b09d0bfdb29fc (127.14.146.194). New cstate: current_term: 1 leader_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b303c4191f4e41f29f3b09d0bfdb29fc" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260808 21:02:11.646842 31649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.644019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57684 (local address 127.14.146.194:39061)
0808 21:02:11.644095 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:11.644097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:11.644108 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:02:11.644155 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:11.644156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:11.644178 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:11.644272 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:02:11.644447 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.645067 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.645948 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:11.646210 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:11.646270 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:11.646427 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:02:11.646542 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:02:11.646607 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:11.646685 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 21:02:11.646709 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:02:11.648829 31148 raft_consensus.cc:1261] T ce68928244be41a8ad9966ed9ce414b6 P efa8cc7837e94531b0b9bb6bbdc605af [term 1 FOLLOWER]: Refusing update from remote peer b303c4191f4e41f29f3b09d0bfdb29fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:02:11.649161 31563 raft_consensus.cc:1261] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 1 FOLLOWER]: Refusing update from remote peer b303c4191f4e41f29f3b09d0bfdb29fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:02:11.649354 31670 consensus_queue.cc:1035] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "efa8cc7837e94531b0b9bb6bbdc605af" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:02:11.649484 31664 consensus_queue.cc:1035] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddf28764fd944b298910160b7300cde" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:02:11.652964 31677 mvcc.cc:205] Tried to move back new op lower bound from 7316369128030568448 to 7316369127768924160. Current Snapshot: MvccSnapshot[applied={T|T < 7316369128030568448}]
I20260808 21:02:11.653105 31676 mvcc.cc:205] Tried to move back new op lower bound from 7316369128030568448 to 7316369127768924160. Current Snapshot: MvccSnapshot[applied={T|T < 7316369128030568448 or (T in {7316369128030568448})}]
I20260808 21:02:11.654961 30937 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:02:11.655098 30937 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:02:11.655896 30937 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 93d89b8ccdb142db98d6ea44d65ca0d8: Sending DeleteTablet for 3 replicas of tablet ce68928244be41a8ad9966ed9ce414b6
I20260808 21:02:11.656291 31326 tablet_service.cc:1514] Processing DeleteTablet for tablet ce68928244be41a8ad9966ed9ce414b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:02:11 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:57680
I20260808 21:02:11.656340 31529 tablet_service.cc:1514] Processing DeleteTablet for tablet ce68928244be41a8ad9966ed9ce414b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:02:11 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:34978
I20260808 21:02:11.656351 31117 tablet_service.cc:1514] Processing DeleteTablet for tablet ce68928244be41a8ad9966ed9ce414b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:02:11 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:59768
I20260808 21:02:11.656579 31694 tablet_replica.cc:330] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: stopping tablet replica
I20260808 21:02:11.656683 31694 raft_consensus.cc:2229] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:02:11.656769 31690 tablet_replica.cc:330] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: stopping tablet replica
I20260808 21:02:11.656783 31694 raft_consensus.cc:2258] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:02:11.656848 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 31022
I20260808 21:02:11.656868 31690 raft_consensus.cc:2229] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:02:11.656955 31690 raft_consensus.cc:2258] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:02:11.657248 31694 ts_tablet_manager.cc:1905] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:02:11.662235 31694 ts_tablet_manager.cc:1918] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:02:11.662299 31694 log.cc:1196] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/ce68928244be41a8ad9966ed9ce414b6
I20260808 21:02:11.662528 31694 ts_tablet_manager.cc:1939] T ce68928244be41a8ad9966ed9ce414b6 P 0ddf28764fd944b298910160b7300cde: Deleting consensus metadata
I20260808 21:02:11.662928 30917 catalog_manager.cc:4841] TS 0ddf28764fd944b298910160b7300cde (127.14.146.195:41063): tablet ce68928244be41a8ad9966ed9ce414b6 (table test-table [id=3ac793b91dbe4bfa828facb2b8414760]) successfully deleted
I20260808 21:02:11.666543 31690 ts_tablet_manager.cc:1905] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:02:11.668527 31690 ts_tablet_manager.cc:1918] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:02:11.668638 31690 log.cc:1196] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/ce68928244be41a8ad9966ed9ce414b6
I20260808 21:02:11.668898 31690 ts_tablet_manager.cc:1939] T ce68928244be41a8ad9966ed9ce414b6 P b303c4191f4e41f29f3b09d0bfdb29fc: Deleting consensus metadata
I20260808 21:02:11.669374 30919 catalog_manager.cc:4841] TS b303c4191f4e41f29f3b09d0bfdb29fc (127.14.146.194:39061): tablet ce68928244be41a8ad9966ed9ce414b6 (table test-table [id=3ac793b91dbe4bfa828facb2b8414760]) successfully deleted
W20260808 21:02:11.673457 30919 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:37021 (error 108)
I20260808 21:02:11.673856 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 31223
I20260808 21:02:11.676578 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:11.673983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:37021 (local address 127.0.0.1:59774)
0808 21:02:11.676478 (+ 2495us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:11.676531 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:37021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2467}
W20260808 21:02:11.676798 30919 catalog_manager.cc:4584] TS efa8cc7837e94531b0b9bb6bbdc605af (127.14.146.193:37021): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ce68928244be41a8ad9966ed9ce414b6: Network error: Client connection negotiation failed: client connection to 127.14.146.193:37021: connect: Connection refused (error 111)
I20260808 21:02:11.682063 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 31434
I20260808 21:02:11.692444 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 30891
2026-08-08T21:02:11Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2404 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:02:11 dist-test-slave-t3q3 krb5kdc[31700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:02:11 dist-test-slave-t3q3 krb5kdc[31700](info): set up 2 sockets
Aug 08 21:02:11 dist-test-slave-t3q3 krb5kdc[31700](info): commencing operation
krb5kdc: starting...
W20260808 21:02:12.940186 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:02:13 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:02:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:02:13Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/rangeradmin_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/rangeradmin_127.14.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/rangerlookup_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/rangerlookup_127.14.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/HTTP_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/HTTP_127.14.146.212@KRBTEST.COM.keytab.
I20260808 21:02:13.106758 14923 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskW6SX4Q/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/postgres -l logfile start
2026-08-08 21:02:15.548 UTC [31742] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 21:02:15.549 UTC [31742] LOG: listening on IPv4 address "127.14.146.212", port 49697
2026-08-08 21:02:15.552 UTC [31742] LOG: listening on Unix socket "/tmp/.s.PGSQL.49697"
2026-08-08 21:02:15.574 UTC [31745] LOG: database system was shut down at 2026-08-08 21:02:14 UTC
2026-08-08 21:02:15.578 UTC [31742] LOG: database system is ready to accept connections
I20260808 21:02:16.746275 14923 mini_postgres.cc:96] Postgres bound to 49697
2026-08-08 21:02:16.755 UTC [31760] FATAL: database "slave" does not exist
127.14.146.212:49697 - accepting connections
I20260808 21:02:16.756297 14923 mini_ranger.cc:161] Starting Ranger...
I20260808 21:02:16.773752 14923 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 21:02:17.234879 14923 mini_ranger.cc:87] Created ranger Postgres database
I20260808 21:02:17.234957 14923 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-admin
2026-08-08 21:02:17,627 [I] DB FLAVOR :POSTGRES
2026-08-08 21:02:17,628 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 21:02:17,628 [I] Checking connection..
2026-08-08 21:02:17,628 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 21:02:17,915 [I] Checking connection passed.
2026-08-08 21:02:17,916 [I] --------- Verifying version history table ---------
2026-08-08 21:02:17,916 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 21:02:18,187 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 21:02:18,187 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 21:02:18,444 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 21:02:18,444 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 21:02:18,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 21:02:18.692 UTC [31854] WARNING: there is no transaction in progress
2026-08-08 21:02:18,701 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 21:02:18,702 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 21:02:18,939 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 21:02:18,940 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 21:02:18,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 21:02:19,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 21:02:19,447 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t3q3.c.gcp-upstream.internal','N') ;"
2026-08-08 21:02:19,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 21:02:19,952 [I] Table x_portal_user does not exist in database ranger
2026-08-08 21:02:19,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 21:02:20,221 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 21:02:20,222 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 21:02:20,487 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 21:02:20,758 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 21:02:20,759 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 21:02:21.725 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.743 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.760 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.775 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.791 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.808 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.861 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.868 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.882 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.892 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.902 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.916 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.925 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.932 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.938 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:21.945 UTC [32011] WARNING: there is no transaction in progress
2026-08-08 21:02:22,562 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 21:02:22,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 21:02:22,823 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 21:02:22,824 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 21:02:23,094 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 21:02:23,095 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 21:02:23,361 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 21:02:23,361 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 21:02:23,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 21:02:23,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t3q3.c.gcp-upstream.internal';"
2026-08-08 21:02:24,099 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 21:02:24,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 21:02:24,361 [I] DB_PATCHES have already been applied
I20260808 21:02:24.366962 14923 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-admin:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskW6SX4Q/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 21:02:24.367028 14923 mini_ranger.cc:193] Using host: 127.14.146.212
I20260808 21:02:24.370934 14923 mini_ranger.cc:227] Ranger admin URL: http://127.14.146.212:35343
Aug 08, 2026 9:02:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 9:02:24 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 9:02:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 9:02:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 9:02:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 9:02:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 9:02:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 21:02:25.949008 14923 mini_ranger.cc:160] Time spent starting Ranger: real 9.193s user 0.000s sys 0.011s
Aug 08, 2026 9:02:45 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 9:02:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 08, 2026 9:02:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 9:02:45 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 9:02:46 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 21:02:46.917850 14923 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/rangerkms_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/rangerkms_127.14.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.146.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.146.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.146.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/HTTP_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.146.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/HTTP_127.14.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 21:02:46 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222966, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 21:02:47.007874 14923 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 21:02:47.018426 14923 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 21:02:47.857569 14923 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 21:02:47.857640 14923 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms
I20260808 21:02:47.857653 14923 mini_ranger_kms.cc:227] Using postgres at 127.14.146.212:49697
2026-08-08 21:02:48,150 [I] DB FLAVOR :POSTGRES
2026-08-08 21:02:48,150 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 21:02:48,151 [I] Checking connection
2026-08-08 21:02:48,151 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 21:02:48,411 [I] connection success
2026-08-08 21:02:48,412 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 21:02:48,412 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 21:02:48,412 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 21:02:48,650 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 21:02:48,650 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 21:02:48,651 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 21:02:48,651 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:49697/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 21:02:48,927 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 21:02:49.384964 14923 mini_ranger_kms.cc:310] Created kms service
I20260808 21:02:49.581558 14923 mini_ranger_kms.cc:326] Created kudu user
I20260808 21:02:49.627791 14923 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 21:02:49 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222966, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:02:50.045680 14923 mini_ranger_kms.cc:384] Added ranger policy
I20260808 21:02:50.045817 14923 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms:/tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 21:02:50.045856 14923 mini_ranger_kms.cc:240] Using host: 127.14.146.212
I20260808 21:02:50.050132 14923 mini_ranger_kms.cc:276] Ranger KMS PID: 32280
I20260808 21:02:50.050251 14923 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.146.212:44729
Aug 08, 2026 9:02:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 9:02:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 9:02:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 9:02:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 9:02:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 9:02:51 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 21:02:51.474222 14923 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.466s user 0.000s sys 0.276s
I20260808 21:02:51.474334 14923 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 21:02:51.474409 14923 mini_ranger_kms.cc:401] 127.14.146.212:44729/kms/v1/keys
Aug 08 21:02:52 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786222972, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.146.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 21:02:52 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222972, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.146.212@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
Aug 08 21:02:52 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222972, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.146.212@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
Aug 08 21:02:55 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:02:55.060911 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39803
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:45953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:39803
--ranger_config_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:44729/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:02:55.145630 32355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:55.145838 32355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:55.145860 32355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:55.146997 32355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:02:55.147044 32355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:55.147059 32355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:55.147073 32355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:02:55.147084 32355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:02:55.148813 32355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:45953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.146.212:44729/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:39803
--ranger_config_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:55.149067 32355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:55.149289 32355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:55.156363 32368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:55.156417 32355 server_base.cc:1034] running on GCE node
W20260808 21:02:55.156592 32366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:55.156381 32365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:55.156971 32355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:55.157341 32355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:55.158531 32355 hybrid_clock.cc:648] HybridClock initialized: now 1786222975158508 us; error 38 us; skew 500 ppm
Aug 08 21:02:55 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222975, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:02:55.164374 32355 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:02:55.164898 32355 webserver.cc:460] Webserver started at http://127.14.146.254:39675/ using document root <none> and password file <none>
I20260808 21:02:55.165141 32355 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:55.165202 32355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:55.165359 32355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 21:02:55 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222975, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:02:55.226672 32355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "d78f04eae0584ab3b4c6c5392e524b60"
format_stamp: "Formatted at 2026-08-08 21:02:55 on dist-test-slave-t3q3"
server_key: "d92c741d26d0f9696e8170ab2a76402f"
server_key_iv: "f3b868de859727ca70935246ff0ad2fc"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:55.227108 32355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "d78f04eae0584ab3b4c6c5392e524b60"
format_stamp: "Formatted at 2026-08-08 21:02:55 on dist-test-slave-t3q3"
server_key: "d92c741d26d0f9696e8170ab2a76402f"
server_key_iv: "f3b868de859727ca70935246ff0ad2fc"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:55.228816 32355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 21:02:55.244747 32378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:55.244975 32355 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:02:55.245090 32355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "d78f04eae0584ab3b4c6c5392e524b60"
format_stamp: "Formatted at 2026-08-08 21:02:55 on dist-test-slave-t3q3"
server_key: "d92c741d26d0f9696e8170ab2a76402f"
server_key_iv: "f3b868de859727ca70935246ff0ad2fc"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:55.245230 32355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:55.259994 32355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:55.262271 32355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:55.262454 32355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:55.267597 32355 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:39803
I20260808 21:02:55.267647 32461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:39803 every 8 connection(s)
I20260808 21:02:55.268026 32355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:02:55.268836 32462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:55.271203 32462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60: Bootstrap starting.
I20260808 21:02:55.271819 32462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:55.272193 32462 log.cc:824] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:55.272927 32462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60: No bootstrap required, opened a new log
I20260808 21:02:55.275050 32462 raft_consensus.cc:348] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78f04eae0584ab3b4c6c5392e524b60" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39803 } }
I20260808 21:02:55.275206 32462 raft_consensus.cc:374] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:55.275233 32462 raft_consensus.cc:729] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d78f04eae0584ab3b4c6c5392e524b60, State: Initialized, Role: FOLLOWER
I20260808 21:02:55.275390 32462 consensus_queue.cc:260] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78f04eae0584ab3b4c6c5392e524b60" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39803 } }
I20260808 21:02:55.275476 32462 raft_consensus.cc:388] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:02:55.275499 32462 raft_consensus.cc:482] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:02:55.275569 32462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:55.276199 32462 raft_consensus.cc:504] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78f04eae0584ab3b4c6c5392e524b60" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39803 } }
I20260808 21:02:55.276325 32462 leader_election.cc:302] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d78f04eae0584ab3b4c6c5392e524b60; no voters:
I20260808 21:02:55.276530 32462 leader_election.cc:288] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:02:55.276559 32466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:02:55.276701 32466 raft_consensus.cc:686] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [term 1 LEADER]: Becoming Leader. State: Replica: d78f04eae0584ab3b4c6c5392e524b60, State: Running, Role: LEADER
I20260808 21:02:55.276834 32462 sys_catalog.cc:564] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:02:55.276858 32466 consensus_queue.cc:237] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78f04eae0584ab3b4c6c5392e524b60" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39803 } }
I20260808 21:02:55.277207 32466 sys_catalog.cc:455] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d78f04eae0584ab3b4c6c5392e524b60. Latest consensus state: current_term: 1 leader_uuid: "d78f04eae0584ab3b4c6c5392e524b60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78f04eae0584ab3b4c6c5392e524b60" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39803 } } }
I20260808 21:02:55.277410 32466 sys_catalog.cc:458] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [sys.catalog]: This master's current role is: LEADER
I20260808 21:02:55.277558 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 32355
I20260808 21:02:55.277674 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:02:55.277839 14923 external_mini_cluster.cc:1428] Setting key f3065e370cfad34344ab5a81005c6a05
I20260808 21:02:55.277225 32469 sys_catalog.cc:455] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d78f04eae0584ab3b4c6c5392e524b60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d78f04eae0584ab3b4c6c5392e524b60" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39803 } } }
I20260808 21:02:55.278023 32469 sys_catalog.cc:458] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60 [sys.catalog]: This master's current role is: LEADER
I20260808 21:02:55.278975 32462 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 21:02:55.284521 32480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:02:55.285307 32480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 21:02:55 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222975, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:02:55.293676 32486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:55.278346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47762 (local address 127.14.146.254:39803)
0808 21:02:55.281492 (+ 3146us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:55.281504 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:55.281557 (+ 53us) server_negotiation.cc:407] Connection header received
0808 21:02:55.281783 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:55.281792 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:55.281878 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:55.282043 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:55.282925 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:55.284330 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:55.285335 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:55.286029 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:55.286143 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:55.289379 (+ 3236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:55.289384 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:55.289384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:55.289397 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:55.291506 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:55.291912 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:55.291916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:55.291916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:55.292029 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:55.292280 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:55.292280 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:55.292281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:55.292612 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:55.292746 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:55.293304 (+ 558us) server_negotiation.cc:299] Negotiation successful
0808 21:02:55.293446 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3027,"thread_start_us":88,"threads_started":1}
I20260808 21:02:55.296630 32480 catalog_manager.cc:1347] Generated new cluster ID: 8505b93c749545698227928ae552896e
I20260808 21:02:55.296703 32480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:02:55.306231 32480 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:02:55.307085 32480 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:02:55.311153 32480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60: Generated new TSK 0
I20260808 21:02:55.311409 32480 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:02:56.024595 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:44729/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39803
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:45953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:02:56.114845 32524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:56.115082 32524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:56.115123 32524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:56.116448 32524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:56.116508 32524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:56.116550 32524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:02:56.118014 32524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:45953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.146.212:44729/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:56.118269 32524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:56.118515 32524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:56.125036 32530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:56.125067 32535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:56.125041 32532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:56.125541 32524 server_base.cc:1034] running on GCE node
I20260808 21:02:56.125764 32524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:56.126039 32524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:56.127226 32524 hybrid_clock.cc:648] HybridClock initialized: now 1786222976127212 us; error 41 us; skew 500 ppm
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:02:56.130517 32524 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:02:56.130930 32524 webserver.cc:460] Webserver started at http://127.14.146.193:37879/ using document root <none> and password file <none>
I20260808 21:02:56.131187 32524 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:56.131264 32524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:56.131420 32524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:02:56.145928 32524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "b3d05eb1c2934911b43db3f20b85f284"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "3dd4557e4a5d2ec3164c0aa3850de4e3"
server_key_iv: "4dd6ecb63ab5ba1231ca2ee426b686fe"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.146381 32524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "b3d05eb1c2934911b43db3f20b85f284"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "3dd4557e4a5d2ec3164c0aa3850de4e3"
server_key_iv: "4dd6ecb63ab5ba1231ca2ee426b686fe"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.148299 32524 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260808 21:02:56.162472 32546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.162706 32524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:02:56.162802 32524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "b3d05eb1c2934911b43db3f20b85f284"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "3dd4557e4a5d2ec3164c0aa3850de4e3"
server_key_iv: "4dd6ecb63ab5ba1231ca2ee426b686fe"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.162899 32524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:56.222200 32524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:56.224560 32524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:56.224750 32524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:56.225056 32524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:56.225473 32524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:56.225530 32524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.225601 32524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:56.225647 32524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.233461 32524 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:35973
I20260808 21:02:56.233836 32524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:02:56.234468 32716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:35973 every 8 connection(s)
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:02:56.243368 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 32524
I20260808 21:02:56.243487 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:02:56.243709 14923 external_mini_cluster.cc:1428] Setting key 17fe7f54607704e93c662089af27cec9
I20260808 21:02:56.243865 32724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.234600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39803 (local address 127.14.146.193:52481)
0808 21:02:56.234858 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:56.234903 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:56.235416 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:56.235710 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:56.235714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:56.235915 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:56.236203 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.236209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.236934 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.236935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.237765 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.237767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.238202 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.238203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.238343 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.238894 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:56.238903 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:56.240274 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:56.242062 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:56.242070 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:56.242073 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:56.242304 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:56.242541 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:56.242542 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:56.242542 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:56.242662 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:56.242938 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:56.242945 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:56.243263 (+ 318us) client_negotiation.cc:769] Sending connection context
0808 21:02:56.243419 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 21:02:56.243601 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":78,"threads_started":1}
I20260808 21:02:56.244253 32725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.234597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:52481 (local address 127.14.146.254:39803)
0808 21:02:56.234923 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.234926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.234985 (+ 59us) server_negotiation.cc:407] Connection header received
0808 21:02:56.235532 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.235534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.235550 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.235636 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:56.236297 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.236833 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.237866 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.238096 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.238193 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.240382 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:56.240384 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:56.240384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:56.240392 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:56.241968 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:56.242399 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:56.242401 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:56.242401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:56.242464 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:56.242734 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:56.242734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:56.242735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:56.242857 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:56.242934 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.244020 (+ 1086us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.244160 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":92,"threads_started":1}
I20260808 21:02:56.245280 32718 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39803
I20260808 21:02:56.245388 32718 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:56.245564 32718 heartbeater.cc:511] Master 127.14.146.254:39803 requested a full tablet report, sending...
I20260808 21:02:56.247823 32397 ts_manager.cc:194] Registered new tserver with Master: b3d05eb1c2934911b43db3f20b85f284 (127.14.146.193:35973)
I20260808 21:02:56.248776 32397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:52481
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:02:56.279675 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:44729/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39803
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:45953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 21:02:56.406268 32728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:56.406539 32728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:56.406585 32728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:56.408413 32728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:56.408483 32728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:56.408522 32728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:02:56.410770 32728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:45953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.146.212:44729/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:56.411175 32728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:56.411652 32728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:56.418192 32737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:56.418251 32738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:56.418478 32743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:56.419474 32728 server_base.cc:1034] running on GCE node
I20260808 21:02:56.419771 32728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:56.420086 32728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:56.421280 32728 hybrid_clock.cc:648] HybridClock initialized: now 1786222976421256 us; error 38 us; skew 500 ppm
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:02:56.424732 32728 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:02:56.425331 32728 webserver.cc:460] Webserver started at http://127.14.146.194:33579/ using document root <none> and password file <none>
I20260808 21:02:56.425640 32728 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:56.425771 32728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:56.425969 32728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:02:56.437080 32728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "9a9220a052758131ab06fb14a570fc0a"
server_key_iv: "77e39f0319cbcd4736ca209e638809a6"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.437759 32728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "9a9220a052758131ab06fb14a570fc0a"
server_key_iv: "77e39f0319cbcd4736ca209e638809a6"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.442677 32728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.000s
I20260808 21:02:56.459235 32754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.459633 32728 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:02:56.459745 32728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "9a9220a052758131ab06fb14a570fc0a"
server_key_iv: "77e39f0319cbcd4736ca209e638809a6"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.459882 32728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:56.473165 32728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:56.475699 32728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:56.475906 32728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:56.476199 32728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:56.476655 32728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:56.476781 32728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.476857 32728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:56.476919 32728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.486514 32728 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:43905
I20260808 21:02:56.487030 32728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:02:56.487592 462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:43905 every 8 connection(s)
I20260808 21:02:56.493170 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 32728
I20260808 21:02:56.493287 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:02:56.493489 14923 external_mini_cluster.cc:1428] Setting key b0b80a8a785fab1b812cd13e8f5ad620
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:02:56.502579 466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.488280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39803 (local address 127.14.146.194:60335)
0808 21:02:56.488847 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:56.488889 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:56.489530 (+ 641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:56.489912 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:56.489917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:56.490168 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:56.490444 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.490450 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.494433 (+ 3983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.494434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.495729 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.495732 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.496357 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.496358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.496501 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.497110 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:56.497121 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:56.498832 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:56.500838 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:56.500845 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:56.500847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:56.501201 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:56.501429 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:56.501429 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:56.501430 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:56.501562 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:56.501881 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:56.501889 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:56.502065 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 21:02:56.502181 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 21:02:56.502339 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":88,"threads_started":1}
I20260808 21:02:56.503136 32725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.488578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:60335 (local address 127.14.146.254:39803)
0808 21:02:56.488627 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.488630 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.488973 (+ 343us) server_negotiation.cc:407] Connection header received
0808 21:02:56.489673 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.489675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.489694 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.489727 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:56.490575 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.491384 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.495841 (+ 4457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.496211 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.496262 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.498943 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:56.498945 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:56.498945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:56.498953 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:56.500737 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:56.501294 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:56.501295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:56.501296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:56.501358 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:56.501644 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:56.501645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:56.501646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:56.501786 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:56.501843 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.502942 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.503047 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:02:56.503484 464 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39803
I20260808 21:02:56.503589 464 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:56.503783 464 heartbeater.cc:511] Master 127.14.146.254:39803 requested a full tablet report, sending...
I20260808 21:02:56.504223 32397 ts_manager.cc:194] Registered new tserver with Master: 4c71fbf2995a4d6fafa7d6e5a6a3f220 (127.14.146.194:43905)
I20260808 21:02:56.504734 32397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:60335
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:02:56.528651 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:44729/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39803
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:45953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:02:56.649289 469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:02:56.649585 469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:02:56.649626 469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:02:56.650857 469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:02:56.650943 469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:02:56.650991 469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:02:56.652580 469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:45953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.146.212:44729/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:02:56.652838 469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:02:56.653092 469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:02:56.658409 474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:56.658502 477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:02:56.658427 475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:02:56.658852 469 server_base.cc:1034] running on GCE node
I20260808 21:02:56.659106 469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:02:56.659374 469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:02:56.660544 469 hybrid_clock.cc:648] HybridClock initialized: now 1786222976660530 us; error 31 us; skew 500 ppm
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:02:56.663494 469 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:02:56.664009 469 webserver.cc:460] Webserver started at http://127.14.146.195:42997/ using document root <none> and password file <none>
I20260808 21:02:56.664350 469 fs_manager.cc:359] Metadata directory not provided
I20260808 21:02:56.664412 469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:02:56.664547 469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:02:56.684389 469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "bad02b9056bf445b956a7db8a8e08554"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "63ec739827304271bd4a36a73106e75c"
server_key_iv: "7ee833c4d751bc42d46928cede5ed585"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.684864 469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "bad02b9056bf445b956a7db8a8e08554"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "63ec739827304271bd4a36a73106e75c"
server_key_iv: "7ee833c4d751bc42d46928cede5ed585"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.692453 469 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260808 21:02:56.704922 491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.705173 469 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:02:56.705281 469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "bad02b9056bf445b956a7db8a8e08554"
format_stamp: "Formatted at 2026-08-08 21:02:56 on dist-test-slave-t3q3"
server_key: "63ec739827304271bd4a36a73106e75c"
server_key_iv: "7ee833c4d751bc42d46928cede5ed585"
server_key_version: "kuduclusterkey@0"
I20260808 21:02:56.705370 469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:02:56.731932 469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:02:56.736809 469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:02:56.737071 469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:02:56.737375 469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:02:56.737933 469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:02:56.738034 469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.738121 469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:02:56.738183 469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:02:56.749517 469 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:45035
I20260808 21:02:56.750470 469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:02:56.756749 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 469
I20260808 21:02:56.756871 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:02:56.757066 14923 external_mini_cluster.cc:1428] Setting key 49c659b20d1a685b97601c8d1b2ccd76
I20260808 21:02:56.757074 660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:45035 every 8 connection(s)
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:02:56.783661 32725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.762213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:40381 (local address 127.14.146.254:39803)
0808 21:02:56.762262 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.762264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.763797 (+ 1533us) server_negotiation.cc:407] Connection header received
0808 21:02:56.768506 (+ 4709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.768507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.768521 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.768567 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:56.769767 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.770592 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.773652 (+ 3060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.773950 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.774001 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.779135 (+ 5134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:56.779137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:56.779137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:56.779146 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:56.780992 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:56.782237 (+ 1245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:56.782239 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:56.782239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:56.782303 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:56.782857 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:56.782858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:56.782858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:56.783008 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:56.783064 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.783456 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.783558 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:02:56.784498 663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.761884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39803 (local address 127.14.146.195:40381)
0808 21:02:56.763651 (+ 1767us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:56.763704 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:56.768358 (+ 4654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:56.768783 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:56.768787 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:56.769074 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:02:56.769646 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.769654 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.771284 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.771285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.773529 (+ 2244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.773532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.774729 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.774730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.774887 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.775578 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:02:56.775588 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:02:56.779011 (+ 3423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:02:56.781115 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:56.781121 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:56.781124 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:56.782142 (+ 1018us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:56.782381 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:02:56.782382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:02:56.782382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:02:56.782760 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:02:56.783104 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:02:56.783110 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:02:56.783284 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 21:02:56.784037 (+ 753us) client_negotiation.cc:240] Negotiation successful
0808 21:02:56.784248 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1714,"thread_start_us":119,"threads_started":1}
I20260808 21:02:56.785181 661 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39803
I20260808 21:02:56.785281 661 heartbeater.cc:464] Registering TS with master...
I20260808 21:02:56.785477 661 heartbeater.cc:511] Master 127.14.146.254:39803 requested a full tablet report, sending...
I20260808 21:02:56.785916 32397 ts_manager.cc:194] Registered new tserver with Master: bad02b9056bf445b956a7db8a8e08554 (127.14.146.195:45035)
I20260808 21:02:56.786406 32397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:40381
I20260808 21:02:56.792629 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:02:56.802755 32725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.794449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47764 (local address 127.14.146.254:39803)
0808 21:02:56.794491 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.794494 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.794861 (+ 367us) server_negotiation.cc:407] Connection header received
0808 21:02:56.794963 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.794964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.794975 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.795004 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:02:56.795896 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.796711 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.797789 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.798076 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.798121 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.799705 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:02:56.799706 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:02:56.799706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:02:56.799713 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:02:56.801407 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:56.801831 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:56.801832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:56.801833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:56.801892 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:02:56.802118 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:02:56.802119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:02:56.802120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:02:56.802253 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:02:56.802330 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.802583 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.802663 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:02:56.805104 32397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:02:56.807494 32397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:02:56.821642 684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.811850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:45035 (local address 127.0.0.1:59092)
0808 21:02:56.812987 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:56.813021 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:56.813061 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:56.813440 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:56.813444 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:56.813446 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:56.813520 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.813522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.815720 (+ 2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.815721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.820122 (+ 4401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.820126 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.821304 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.821306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.821385 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.821401 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 21:02:56.821470 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 21:02:56.821522 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1123,"thread_start_us":74,"threads_started":1}
I20260808 21:02:56.822840 687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.812253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59092 (local address 127.14.146.195:45035)
0808 21:02:56.813184 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.813189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.813199 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:02:56.813240 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.813242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.813259 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.813338 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:56.813627 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.815622 (+ 1995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.820247 (+ 4625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.821096 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.821196 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.821264 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.822708 (+ 1444us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.822753 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":892,"thread_start_us":88,"threads_started":1}
I20260808 21:02:56.823684 561 tablet_service.cc:1467] Processing CreateTablet for tablet 854a25b82ec04261866e70e567ee8707 (DEFAULT_TABLE table=test-table [id=92ce0674644a4eb3ae5f2fd6c57b3566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:02:56.824276 561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 854a25b82ec04261866e70e567ee8707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:56.828585 681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.811320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:43905 (local address 127.0.0.1:48226)
0808 21:02:56.812771 (+ 1451us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:56.812813 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:56.812884 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:56.815054 (+ 2170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:56.815055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:56.815057 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:56.815101 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.815103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.818122 (+ 3019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.818123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.819271 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.819275 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.828311 (+ 9036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.828312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.828385 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.828389 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:02:56.828449 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 21:02:56.828491 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1418,"thread_start_us":76,"threads_started":1}
I20260808 21:02:56.828624 680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.811612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48226 (local address 127.14.146.194:43905)
0808 21:02:56.814830 (+ 3218us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.814835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.814845 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:02:56.814884 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.814886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.814902 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.814972 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:56.816914 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.818015 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.822147 (+ 4132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.828046 (+ 5899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.828205 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.828273 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.828472 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.828522 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3174,"thread_start_us":85,"threads_started":1}
I20260808 21:02:56.829680 359 tablet_service.cc:1467] Processing CreateTablet for tablet 854a25b82ec04261866e70e567ee8707 (DEFAULT_TABLE table=test-table [id=92ce0674644a4eb3ae5f2fd6c57b3566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:02:56.830040 359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 854a25b82ec04261866e70e567ee8707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:56.833947 689 tablet_bootstrap.cc:492] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: Bootstrap starting.
I20260808 21:02:56.835023 689 tablet_bootstrap.cc:654] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:56.835395 689 log.cc:824] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:56.836225 689 tablet_bootstrap.cc:492] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: No bootstrap required, opened a new log
I20260808 21:02:56.836292 689 ts_tablet_manager.cc:1397] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:02:56.838135 689 raft_consensus.cc:348] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:56.838291 689 raft_consensus.cc:374] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:56.838321 689 raft_consensus.cc:729] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c71fbf2995a4d6fafa7d6e5a6a3f220, State: Initialized, Role: FOLLOWER
I20260808 21:02:56.838428 689 consensus_queue.cc:260] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:56.838685 689 ts_tablet_manager.cc:1428] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:02:56.838865 464 heartbeater.cc:503] Master 127.14.146.254:39803 was elected leader, sending a full tablet report...
I20260808 21:02:56.843017 679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.812040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:35973 (local address 127.0.0.1:39914)
0808 21:02:56.814637 (+ 2597us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:56.814648 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:56.814697 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:56.819684 (+ 4987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:56.819685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:56.819687 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:56.819748 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.819750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.821066 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.821067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.823784 (+ 2717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.823788 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.842729 (+ 18941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.842731 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.842813 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.842819 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 21:02:56.842880 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 21:02:56.842930 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2580,"thread_start_us":97,"threads_started":1}
I20260808 21:02:56.843564 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.812228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39914 (local address 127.14.146.193:35973)
0808 21:02:56.819435 (+ 7207us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.819440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.819453 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:02:56.819490 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.819493 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.819508 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.819605 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:56.819826 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.820958 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.841763 (+ 20805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.842622 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.842716 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.842774 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.843421 (+ 647us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.843474 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7167,"thread_start_us":70,"threads_started":1}
I20260808 21:02:56.844338 32622 tablet_service.cc:1467] Processing CreateTablet for tablet 854a25b82ec04261866e70e567ee8707 (DEFAULT_TABLE table=test-table [id=92ce0674644a4eb3ae5f2fd6c57b3566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:02:56.844707 32622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 854a25b82ec04261866e70e567ee8707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:02:56.845257 688 tablet_bootstrap.cc:492] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Bootstrap starting.
I20260808 21:02:56.848608 688 tablet_bootstrap.cc:654] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:56.849025 688 log.cc:824] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Log is configured to *not* fsync() on all Append() calls
I20260808 21:02:56.849238 691 raft_consensus.cc:482] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:02:56.849346 691 raft_consensus.cc:504] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:56.849517 692 tablet_bootstrap.cc:492] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284: Bootstrap starting.
I20260808 21:02:56.850052 691 leader_election.cc:288] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bad02b9056bf445b956a7db8a8e08554 (127.14.146.195:45035), b3d05eb1c2934911b43db3f20b85f284 (127.14.146.193:35973)
I20260808 21:02:56.853336 466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.849790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:45035 (local address 127.14.146.194:42045)
0808 21:02:56.849832 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:56.849844 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:56.849890 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:56.850073 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:56.850074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:56.850076 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:56.850143 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.850144 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.851080 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.851082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.852281 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.852284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.853100 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.853101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.853183 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.853187 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:02:56.853234 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 21:02:56.853270 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 21:02:56.853820 687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.849858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:42045 (local address 127.14.146.195:45035)
0808 21:02:56.849900 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.849902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.849940 (+ 38us) server_negotiation.cc:407] Connection header received
0808 21:02:56.849965 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.849966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.849977 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.850020 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:56.850260 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.850979 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.852403 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.852965 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.853057 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.853066 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.853714 (+ 648us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.853759 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:02:56.854049 585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854a25b82ec04261866e70e567ee8707" candidate_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad02b9056bf445b956a7db8a8e08554" is_pre_election: true
W20260808 21:02:56.855656 32758 leader_election.cc:341] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bad02b9056bf445b956a7db8a8e08554 (127.14.146.195:45035): Illegal state: must be running to vote when last-logged opid is not known
I20260808 21:02:56.859014 466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.849953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:35973 (local address 127.14.146.194:52913)
0808 21:02:56.853400 (+ 3447us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:56.853410 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:56.853443 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:56.856031 (+ 2588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:56.856032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:56.856034 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:56.856088 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.856089 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.856965 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.856965 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.858035 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:56.858038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.858815 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.858816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:56.858878 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.858882 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:02:56.858912 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 21:02:56.858945 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3439,"thread_start_us":74,"threads_started":1}
I20260808 21:02:56.859470 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:56.855849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:52913 (local address 127.14.146.193:35973)
0808 21:02:56.855889 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:56.855891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:56.855901 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:02:56.855924 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:56.855926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:56.855935 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:56.856151 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:56.856184 (+ 33us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.856862 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.858146 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:56.858711 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:56.859344 (+ 633us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:56.859355 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:56.859374 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 21:02:56.859411 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:02:56.859833 32650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854a25b82ec04261866e70e567ee8707" candidate_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3d05eb1c2934911b43db3f20b85f284" is_pre_election: true
W20260808 21:02:56.861104 32758 leader_election.cc:341] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3d05eb1c2934911b43db3f20b85f284 (127.14.146.193:35973): Illegal state: must be running to vote when last-logged opid is not known
I20260808 21:02:56.861192 32758 leader_election.cc:302] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c71fbf2995a4d6fafa7d6e5a6a3f220; no voters: b3d05eb1c2934911b43db3f20b85f284, bad02b9056bf445b956a7db8a8e08554
I20260808 21:02:56.861419 691 raft_consensus.cc:2726] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 21:02:56.862124 692 tablet_bootstrap.cc:654] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284: Neither blocks nor log segments found. Creating new log.
I20260808 21:02:56.862535 692 log.cc:824] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284: Log is configured to *not* fsync() on all Append() calls
Aug 08 21:02:56 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:02:56.863077 688 tablet_bootstrap.cc:492] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: No bootstrap required, opened a new log
I20260808 21:02:56.863168 688 ts_tablet_manager.cc:1397] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260808 21:02:56.863356 692 tablet_bootstrap.cc:492] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284: No bootstrap required, opened a new log
I20260808 21:02:56.863426 692 ts_tablet_manager.cc:1397] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260808 21:02:56.864624 688 raft_consensus.cc:348] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:56.864774 688 raft_consensus.cc:374] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:56.864706 692 raft_consensus.cc:348] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:56.864813 692 raft_consensus.cc:374] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:02:56.864810 688 raft_consensus.cc:729] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bad02b9056bf445b956a7db8a8e08554, State: Initialized, Role: FOLLOWER
I20260808 21:02:56.864851 692 raft_consensus.cc:729] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3d05eb1c2934911b43db3f20b85f284, State: Initialized, Role: FOLLOWER
I20260808 21:02:56.864956 688 consensus_queue.cc:260] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:56.864954 692 consensus_queue.cc:260] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:56.865238 692 ts_tablet_manager.cc:1428] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:02:56.865247 688 ts_tablet_manager.cc:1428] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:02:56.865371 32718 heartbeater.cc:503] Master 127.14.146.254:39803 was elected leader, sending a full tablet report...
I20260808 21:02:56.865658 661 heartbeater.cc:503] Master 127.14.146.254:39803 was elected leader, sending a full tablet report...
W20260808 21:02:56.984951 32723 tablet.cc:2369] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:02:56.987845 465 tablet.cc:2369] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:02:57.011729 662 tablet.cc:2369] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:02:57.031090 697 raft_consensus.cc:482] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:02:57.031270 697 raft_consensus.cc:504] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:57.031685 697 leader_election.cc:288] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c71fbf2995a4d6fafa7d6e5a6a3f220 (127.14.146.194:43905), bad02b9056bf445b956a7db8a8e08554 (127.14.146.195:45035)
I20260808 21:02:57.036234 680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:57.032169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:40869 (local address 127.14.146.194:43905)
0808 21:02:57.032214 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:57.032217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:57.032372 (+ 155us) server_negotiation.cc:407] Connection header received
0808 21:02:57.032502 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:57.032503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:57.032515 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:57.032551 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:57.032867 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.033662 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.035213 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.035795 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.035848 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:57.035858 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:57.036114 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 21:02:57.036159 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:02:57.036496 699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:57.031894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:43905 (local address 127.14.146.193:40869)
0808 21:02:57.032281 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:57.032294 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:57.032408 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:57.032655 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:57.032657 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:57.032659 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:57.032780 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:57.032783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.033772 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.033773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:57.035094 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:57.035099 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.035921 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.035922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:57.035997 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:57.036001 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:02:57.036360 (+ 359us) client_negotiation.cc:240] Negotiation successful
0808 21:02:57.036410 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":129,"threads_started":1}
I20260808 21:02:57.036835 388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854a25b82ec04261866e70e567ee8707" candidate_uuid: "b3d05eb1c2934911b43db3f20b85f284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" is_pre_election: true
I20260808 21:02:57.036991 388 raft_consensus.cc:2454] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d05eb1c2934911b43db3f20b85f284 in term 0.
I20260808 21:02:57.037207 32549 leader_election.cc:302] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c71fbf2995a4d6fafa7d6e5a6a3f220, b3d05eb1c2934911b43db3f20b85f284; no voters:
I20260808 21:02:57.037379 697 raft_consensus.cc:2781] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:02:57.037428 697 raft_consensus.cc:482] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:02:57.037458 697 raft_consensus.cc:3037] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:57.038059 687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:57.032196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:52873 (local address 127.14.146.195:45035)
0808 21:02:57.032251 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:57.032253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:57.032425 (+ 172us) server_negotiation.cc:407] Connection header received
0808 21:02:57.032558 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:57.032559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:57.032569 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:57.032601 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:02:57.032867 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.033603 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.037082 (+ 3479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.037651 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.037726 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:57.037735 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:57.037936 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 21:02:57.037987 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:02:57.038508 697 raft_consensus.cc:504] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:57.038666 697 leader_election.cc:288] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [CANDIDATE]: Term 1 election: Requested vote from peers 4c71fbf2995a4d6fafa7d6e5a6a3f220 (127.14.146.194:43905), bad02b9056bf445b956a7db8a8e08554 (127.14.146.195:45035)
I20260808 21:02:57.038787 698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:57.031906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:45035 (local address 127.14.146.193:52873)
0808 21:02:57.032346 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:57.032358 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:02:57.032457 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:02:57.032675 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:02:57.032676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:02:57.032678 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:02:57.032776 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:57.032778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.035798 (+ 3020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.035799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:57.036980 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:02:57.036983 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.037767 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.037768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:02:57.037854 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:57.037858 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:02:57.038194 (+ 336us) client_negotiation.cc:240] Negotiation successful
0808 21:02:57.038657 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":144,"threads_started":1}
I20260808 21:02:57.039232 585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854a25b82ec04261866e70e567ee8707" candidate_uuid: "b3d05eb1c2934911b43db3f20b85f284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad02b9056bf445b956a7db8a8e08554" is_pre_election: true
I20260808 21:02:57.039281 388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854a25b82ec04261866e70e567ee8707" candidate_uuid: "b3d05eb1c2934911b43db3f20b85f284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220"
I20260808 21:02:57.039382 388 raft_consensus.cc:3037] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:57.039407 585 raft_consensus.cc:2454] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3d05eb1c2934911b43db3f20b85f284 in term 0.
I20260808 21:02:57.039520 588 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "854a25b82ec04261866e70e567ee8707" candidate_uuid: "b3d05eb1c2934911b43db3f20b85f284" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bad02b9056bf445b956a7db8a8e08554"
I20260808 21:02:57.039609 588 raft_consensus.cc:3037] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:02:57.040335 388 raft_consensus.cc:2454] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d05eb1c2934911b43db3f20b85f284 in term 1.
I20260808 21:02:57.040524 32549 leader_election.cc:302] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c71fbf2995a4d6fafa7d6e5a6a3f220, b3d05eb1c2934911b43db3f20b85f284; no voters:
I20260808 21:02:57.040577 588 raft_consensus.cc:2454] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3d05eb1c2934911b43db3f20b85f284 in term 1.
I20260808 21:02:57.040714 697 raft_consensus.cc:2781] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:02:57.040911 697 raft_consensus.cc:686] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [term 1 LEADER]: Becoming Leader. State: Replica: b3d05eb1c2934911b43db3f20b85f284, State: Running, Role: LEADER
I20260808 21:02:57.041044 697 consensus_queue.cc:237] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } }
I20260808 21:02:57.041927 32397 catalog_manager.cc:5495] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3d05eb1c2934911b43db3f20b85f284 (127.14.146.193). New cstate: current_term: 1 leader_uuid: "b3d05eb1c2934911b43db3f20b85f284" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3d05eb1c2934911b43db3f20b85f284" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35973 } health_report { overall_health: HEALTHY } } }
I20260808 21:02:57.100500 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:57.096985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39920 (local address 127.14.146.193:35973)
0808 21:02:57.097110 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 21:02:57.097112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:02:57.097120 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:02:57.097166 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:02:57.097167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:02:57.097190 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:02:57.097259 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:02:57.097482 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.098215 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.099318 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:02:57.099642 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:02:57.099712 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:02:57.099922 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:02:57.100092 (+ 170us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:02:57.100184 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 21:02:57.100364 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 21:02:57.100388 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 21:02:57.102617 588 raft_consensus.cc:1261] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 1 FOLLOWER]: Refusing update from remote peer b3d05eb1c2934911b43db3f20b85f284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:02:57.102747 388 raft_consensus.cc:1261] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 1 FOLLOWER]: Refusing update from remote peer b3d05eb1c2934911b43db3f20b85f284: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:02:57.103085 701 consensus_queue.cc:1035] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c71fbf2995a4d6fafa7d6e5a6a3f220" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:02:57.103283 697 consensus_queue.cc:1035] T 854a25b82ec04261866e70e567ee8707 P b3d05eb1c2934911b43db3f20b85f284 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bad02b9056bf445b956a7db8a8e08554" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:02:57.108946 707 mvcc.cc:205] Tried to move back new op lower bound from 7316369314209472512 to 7316369313960738816. Current Snapshot: MvccSnapshot[applied={T|T < 7316369314209472512}]
I20260808 21:02:57.110172 710 mvcc.cc:205] Tried to move back new op lower bound from 7316369314209472512 to 7316369313960738816. Current Snapshot: MvccSnapshot[applied={T|T < 7316369314209472512}]
I20260808 21:02:57.114593 32397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:02:57.114697 32397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:02:57.115471 32397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d78f04eae0584ab3b4c6c5392e524b60: Sending DeleteTablet for 3 replicas of tablet 854a25b82ec04261866e70e567ee8707
I20260808 21:02:57.116133 359 tablet_service.cc:1514] Processing DeleteTablet for tablet 854a25b82ec04261866e70e567ee8707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:02:57 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:48226
I20260808 21:02:57.116379 561 tablet_service.cc:1514] Processing DeleteTablet for tablet 854a25b82ec04261866e70e567ee8707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:02:57 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:59092
I20260808 21:02:57.116590 32622 tablet_service.cc:1514] Processing DeleteTablet for tablet 854a25b82ec04261866e70e567ee8707 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:02:57 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:39914
I20260808 21:02:57.117214 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 32524
I20260808 21:02:57.117894 723 tablet_replica.cc:330] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: stopping tablet replica
I20260808 21:02:57.118001 723 raft_consensus.cc:2229] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:02:57.118112 723 raft_consensus.cc:2258] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:02:57.120352 725 tablet_replica.cc:330] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: stopping tablet replica
I20260808 21:02:57.120464 725 raft_consensus.cc:2229] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:02:57.120563 725 raft_consensus.cc:2258] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:02:57.121075 725 ts_tablet_manager.cc:1905] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:02:57.124326 725 ts_tablet_manager.cc:1918] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:02:57.124393 725 log.cc:1196] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/854a25b82ec04261866e70e567ee8707
I20260808 21:02:57.124656 725 ts_tablet_manager.cc:1939] T 854a25b82ec04261866e70e567ee8707 P bad02b9056bf445b956a7db8a8e08554: Deleting consensus metadata
Aug 08 21:02:57 dist-test-slave-t3q3 krb5kdc[31700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222976, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:02:57.127678 32382 catalog_manager.cc:4841] TS bad02b9056bf445b956a7db8a8e08554 (127.14.146.195:45035): tablet 854a25b82ec04261866e70e567ee8707 (table test-table [id=92ce0674644a4eb3ae5f2fd6c57b3566]) successfully deleted
W20260808 21:02:57.139173 32382 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:35973 (error 108)
I20260808 21:02:57.139678 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 32728
I20260808 21:02:57.139814 723 ts_tablet_manager.cc:1905] T 854a25b82ec04261866e70e567ee8707 P 4c71fbf2995a4d6fafa7d6e5a6a3f220: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:02:57.161931 679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:57.161733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:35973 (local address 127.0.0.1:39930)
0808 21:02:57.161790 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:57.161878 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:35973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 21:02:57.162120 32382 catalog_manager.cc:4584] TS b3d05eb1c2934911b43db3f20b85f284 (127.14.146.193:35973): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 854a25b82ec04261866e70e567ee8707: Network error: Client connection negotiation failed: client connection to 127.14.146.193:35973: connect: Connection refused (error 111)
I20260808 21:02:57.167498 679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:02:57.167380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:43905 (local address 127.0.0.1:48240)
0808 21:02:57.167423 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 21:02:57.167456 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.194:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 21:02:57.167618 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 469
I20260808 21:02:57.177210 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 32355
I20260808 21:02:57.197942 14923 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 21:02:57.545243 14923 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 21:02:57.545356 14923 mini_ranger.cc:66] Stopping Ranger...
I20260808 21:02:57.900408 14923 mini_ranger.cc:68] Stopped Ranger
2026-08-08 21:02:57.900 UTC [31742] LOG: received smart shutdown request
2026-08-08 21:02:57.904 UTC [31742] LOG: background worker "logical replication launcher" (PID 31754) exited with exit code 1
2026-08-08 21:02:57.906 UTC [31746] LOG: shutting down
2026-08-08 21:02:58.059 UTC [31742] LOG: database system is shut down
2026-08-08T21:02:58Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46468 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:02:58 dist-test-slave-t3q3 krb5kdc[742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:02:58 dist-test-slave-t3q3 krb5kdc[742](info): set up 2 sockets
Aug 08 21:02:58 dist-test-slave-t3q3 krb5kdc[742](info): commencing operation
krb5kdc: starting...
W20260808 21:02:59.466661 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:02:59 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786222979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:02:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:02:59Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/rangeradmin_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/rangeradmin_127.14.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/rangerlookup_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/rangerlookup_127.14.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/HTTP_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/HTTP_127.14.146.212@KRBTEST.COM.keytab.
I20260808 21:02:59.630957 14923 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskW6SX4Q/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/postgres -l logfile start
2026-08-08 21:03:01.957 UTC [798] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 21:03:01.957 UTC [798] LOG: listening on IPv4 address "127.14.146.212", port 38703
2026-08-08 21:03:01.960 UTC [798] LOG: listening on Unix socket "/tmp/.s.PGSQL.38703"
2026-08-08 21:03:01.992 UTC [801] LOG: database system was shut down at 2026-08-08 21:03:00 UTC
2026-08-08 21:03:01.996 UTC [798] LOG: database system is ready to accept connections
I20260808 21:03:03.171439 14923 mini_postgres.cc:96] Postgres bound to 38703
2026-08-08 21:03:03.178 UTC [812] FATAL: database "slave" does not exist
127.14.146.212:38703 - accepting connections
I20260808 21:03:03.179072 14923 mini_ranger.cc:161] Starting Ranger...
I20260808 21:03:03.194416 14923 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 21:03:03.627681 14923 mini_ranger.cc:87] Created ranger Postgres database
I20260808 21:03:03.627766 14923 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-admin
2026-08-08 21:03:03,908 [I] DB FLAVOR :POSTGRES
2026-08-08 21:03:03,909 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 21:03:03,909 [I] Checking connection..
2026-08-08 21:03:03,909 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 21:03:04,179 [I] Checking connection passed.
2026-08-08 21:03:04,180 [I] --------- Verifying version history table ---------
2026-08-08 21:03:04,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 21:03:04,443 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 21:03:04,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 21:03:04,683 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 21:03:04,684 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 21:03:04,684 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 21:03:04.941 UTC [902] WARNING: there is no transaction in progress
2026-08-08 21:03:04,949 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 21:03:04,950 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 21:03:05,198 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 21:03:05,199 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 21:03:05,199 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 21:03:05,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 21:03:05,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t3q3.c.gcp-upstream.internal','N') ;"
2026-08-08 21:03:05,959 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 21:03:06,237 [I] Table x_portal_user does not exist in database ranger
2026-08-08 21:03:06,237 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 21:03:06,497 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 21:03:06,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 21:03:06,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 21:03:07,000 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 21:03:07,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 21:03:07.931 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:07.947 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:07.964 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:07.982 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.001 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.022 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.084 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.091 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.104 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.115 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.125 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.138 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.147 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.154 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.160 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08.166 UTC [1078] WARNING: there is no transaction in progress
2026-08-08 21:03:08,740 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 21:03:08,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 21:03:09,006 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 21:03:09,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 21:03:09,271 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 21:03:09,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 21:03:09,535 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 21:03:09,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 21:03:09,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 21:03:10,062 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t3q3.c.gcp-upstream.internal';"
2026-08-08 21:03:10,291 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 21:03:10,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 21:03:10,535 [I] DB_PATCHES have already been applied
I20260808 21:03:10.540994 14923 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-admin:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskW6SX4Q/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 21:03:10.541064 14923 mini_ranger.cc:193] Using host: 127.14.146.212
I20260808 21:03:10.545120 14923 mini_ranger.cc:227] Ranger admin URL: http://127.14.146.212:34197
Aug 08, 2026 9:03:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 9:03:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 9:03:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 9:03:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 9:03:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 9:03:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 9:03:11 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 21:03:11.937980 14923 mini_ranger.cc:160] Time spent starting Ranger: real 8.759s user 0.000s sys 0.010s
Aug 08, 2026 9:03:32 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 9:03:32 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 08, 2026 9:03:32 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 9:03:32 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 9:03:33 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 21:03:33.625981 14923 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/rangerkms_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/rangerkms_127.14.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.146.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.146.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.146.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/HTTP_127.14.146.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.146.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/HTTP_127.14.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 21:03:33 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223013, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 21:03:33.714354 14923 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 21:03:33.724823 14923 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 21:03:34.562769 14923 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 21:03:34.562858 14923 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms
I20260808 21:03:34.562876 14923 mini_ranger_kms.cc:227] Using postgres at 127.14.146.212:38703
2026-08-08 21:03:34,766 [I] DB FLAVOR :POSTGRES
2026-08-08 21:03:34,767 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 21:03:34,767 [I] Checking connection
2026-08-08 21:03:34,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 21:03:35,020 [I] connection success
2026-08-08 21:03:35,020 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 21:03:35,020 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 21:03:35,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 21:03:35,258 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 21:03:35,259 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 21:03:35,259 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 21:03:35,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.146.212:38703/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 21:03:35,549 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 21:03:36.047838 14923 mini_ranger_kms.cc:310] Created kms service
I20260808 21:03:36.244002 14923 mini_ranger_kms.cc:326] Created kudu user
I20260808 21:03:36.288102 14923 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 21:03:36 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223013, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:36.668205 14923 mini_ranger_kms.cc:384] Added ranger policy
I20260808 21:03:36.668339 14923 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms:/tmp/dist-test-taskW6SX4Q/build/release/bin/postgresql.jar:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskW6SX4Q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 21:03:36.668358 14923 mini_ranger_kms.cc:240] Using host: 127.14.146.212
I20260808 21:03:36.672851 14923 mini_ranger_kms.cc:276] Ranger KMS PID: 1352
I20260808 21:03:36.672946 14923 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.146.212:60607
Aug 08, 2026 9:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 9:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 9:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 9:03:37 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 9:03:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 9:03:38 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 21:03:38 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786223018, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.146.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 21:03:39 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223018, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.146.212@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:39.469856 14923 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.756s user 0.014s sys 0.171s
I20260808 21:03:39.469971 14923 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 21:03:39.470019 14923 mini_ranger_kms.cc:401] 127.14.146.212:60607/kms/v1/keys
Aug 08 21:03:39 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223018, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.146.212@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
Aug 08 21:03:41 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:03:41.985041 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39133
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:39133
--ranger_config_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:60607/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:42.068677 1424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:42.068931 1424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:42.068969 1424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:42.070185 1424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:42.070259 1424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:42.070286 1424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:42.070317 1424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:42.070343 1424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:42.071943 1424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.146.212:60607/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:39133
--ranger_config_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:42.072274 1424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:42.072510 1424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 21:03:42.077821 1424 server_base.cc:1034] running on GCE node
W20260808 21:03:42.077960 1431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:42.078032 1434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:42.077885 1432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:42.078413 1424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:42.078735 1424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:42.079877 1424 hybrid_clock.cc:648] HybridClock initialized: now 1786223022079867 us; error 32 us; skew 500 ppm
Aug 08 21:03:42 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223022, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:42.082505 1424 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:03:42.082906 1424 webserver.cc:460] Webserver started at http://127.14.146.254:33333/ using document root <none> and password file <none>
I20260808 21:03:42.083084 1424 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:42.083122 1424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:42.083215 1424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 21:03:42 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223022, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:42.140383 1424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "5b42511b0c724450beeba7bb86a43565"
format_stamp: "Formatted at 2026-08-08 21:03:42 on dist-test-slave-t3q3"
server_key: "cd059c48615278daf7ac05d4077954b0"
server_key_iv: "f8b55c6fae7a2a88de6f180743b3e813"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:42.140866 1424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "5b42511b0c724450beeba7bb86a43565"
format_stamp: "Formatted at 2026-08-08 21:03:42 on dist-test-slave-t3q3"
server_key: "cd059c48615278daf7ac05d4077954b0"
server_key_iv: "f8b55c6fae7a2a88de6f180743b3e813"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:42.142743 1424 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 21:03:42.156981 1445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:42.157203 1424 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:03:42.157303 1424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "5b42511b0c724450beeba7bb86a43565"
format_stamp: "Formatted at 2026-08-08 21:03:42 on dist-test-slave-t3q3"
server_key: "cd059c48615278daf7ac05d4077954b0"
server_key_iv: "f8b55c6fae7a2a88de6f180743b3e813"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:42.157399 1424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:42.175500 1424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:42.177307 1424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:42.177474 1424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:42.181856 1424 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:39133
I20260808 21:03:42.181902 1517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:39133 every 8 connection(s)
I20260808 21:03:42.182272 1424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:03:42.182981 1519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:42.185339 1519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Bootstrap starting.
I20260808 21:03:42.185943 1519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:42.186261 1519 log.cc:824] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:42.186952 1519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: No bootstrap required, opened a new log
I20260808 21:03:42.189023 1519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } }
I20260808 21:03:42.189182 1519 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:42.189206 1519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b42511b0c724450beeba7bb86a43565, State: Initialized, Role: FOLLOWER
I20260808 21:03:42.189384 1519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } }
I20260808 21:03:42.189447 1519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:03:42.189469 1519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:03:42.189539 1519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:42.190073 1519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } }
I20260808 21:03:42.190196 1519 leader_election.cc:302] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b42511b0c724450beeba7bb86a43565; no voters:
I20260808 21:03:42.190380 1519 leader_election.cc:288] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:03:42.190430 1528 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:03:42.190608 1528 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 1 LEADER]: Becoming Leader. State: Replica: 5b42511b0c724450beeba7bb86a43565, State: Running, Role: LEADER
I20260808 21:03:42.190680 1519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:03:42.190770 1528 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } }
I20260808 21:03:42.191175 1530 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b42511b0c724450beeba7bb86a43565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } } }
I20260808 21:03:42.191401 1530 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:42.191329 1531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b42511b0c724450beeba7bb86a43565. Latest consensus state: current_term: 1 leader_uuid: "5b42511b0c724450beeba7bb86a43565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } } }
I20260808 21:03:42.191563 1531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:42.191785 1542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:03:42.192241 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 1424
I20260808 21:03:42.192361 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:03:42.192378 1542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:03:42.192580 14923 external_mini_cluster.cc:1428] Setting key e72fb6624b7852f0dd862ffe2d537e9a
I20260808 21:03:42.192736 1519 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 21:03:42.198654 1542 catalog_manager.cc:1347] Generated new cluster ID: 54959c16c56442b5a7e6440e047b3adf
I20260808 21:03:42.198817 1542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:03:42 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:42.205533 1559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:42.193120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36104 (local address 127.14.146.254:39133)
0808 21:03:42.193287 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:42.193298 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:42.193334 (+ 36us) server_negotiation.cc:407] Connection header received
0808 21:03:42.194986 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:42.195060 (+ 74us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:42.195233 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:42.195459 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:42.196315 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:42.197629 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:42.198780 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:42.199298 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:42.199461 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:42.201946 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:42.201950 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:42.201950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:42.201963 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:42.203902 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:42.204328 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:42.204331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:42.204332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:42.204428 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:42.204654 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:42.204655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:42.204655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:42.204919 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:42.205084 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:42.205203 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 21:03:42.205333 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
I20260808 21:03:42.211954 1542 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:03:42.212477 1542 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:03:42.218811 1542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Generated new TSK 0
I20260808 21:03:42.218989 1542 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:03:42.961522 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:60607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39133
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:43.073942 1590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:43.074213 1590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:43.074251 1590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:43.075870 1590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:43.075929 1590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:43.075968 1590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:03:43.077616 1590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.146.212:60607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:43.077896 1590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:43.078135 1590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:43.083729 1599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:43.083643 1601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:43.083624 1598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:43.084795 1590 server_base.cc:1034] running on GCE node
I20260808 21:03:43.085016 1590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:43.085318 1590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:43.086573 1590 hybrid_clock.cc:648] HybridClock initialized: now 1786223023086552 us; error 34 us; skew 500 ppm
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:43.089887 1590 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:03:43.090448 1590 webserver.cc:460] Webserver started at http://127.14.146.193:45925/ using document root <none> and password file <none>
I20260808 21:03:43.090737 1590 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:43.090791 1590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:43.090916 1590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:43.104771 1590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "cab752670cbf3e0f35a27b2a08e271b9"
server_key_iv: "94ea0e7820cd13422dd4a01c799c7b77"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.105278 1590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "cab752670cbf3e0f35a27b2a08e271b9"
server_key_iv: "94ea0e7820cd13422dd4a01c799c7b77"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.108204 1590 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 21:03:43.119473 1616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.119767 1590 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:43.119879 1590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "cab752670cbf3e0f35a27b2a08e271b9"
server_key_iv: "94ea0e7820cd13422dd4a01c799c7b77"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.119987 1590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:43.142956 1590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:43.145092 1590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:43.145234 1590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:43.145510 1590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:43.145903 1590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:43.145942 1590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.145967 1590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:43.146042 1590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.153476 1590 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:33231
I20260808 21:03:43.153848 1590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:03:43.154982 1797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:33231 every 8 connection(s)
I20260808 21:03:43.159116 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 1590
I20260808 21:03:43.159225 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:03:43.159423 14923 external_mini_cluster.cc:1428] Setting key e09d784d269514251f88510022c85b93
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:43.169849 1802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:43.154640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39133 (local address 127.14.146.193:54901)
0808 21:03:43.155164 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:43.155206 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:43.155717 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:43.155997 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:43.156001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:43.156261 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:43.156458 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:43.156463 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.157439 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.157440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:43.158753 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:43.158757 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.159439 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.159440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:43.159656 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:43.164352 (+ 4696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:43.164363 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:43.166058 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:43.168191 (+ 2133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:43.168197 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:43.168200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:43.168493 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:43.168734 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:43.168735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:43.168735 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:43.168868 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:43.169170 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:43.169176 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:43.169339 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 21:03:43.169446 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 21:03:43.169613 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":106,"threads_started":1}
I20260808 21:03:43.170400 1800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:43.154658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:54901 (local address 127.14.146.254:39133)
0808 21:03:43.154813 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:43.154815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:43.155294 (+ 479us) server_negotiation.cc:407] Connection header received
0808 21:03:43.155824 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:43.155825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:43.155841 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:43.155925 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:43.156560 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.157319 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.158859 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.159232 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.159351 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:43.166176 (+ 6825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:43.166177 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:43.166177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:43.166185 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:43.168093 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:43.168582 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:43.168584 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:43.168584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:43.168662 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:43.168942 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:43.168943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:43.168943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:43.169083 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:43.169143 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:43.170211 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0808 21:03:43.170302 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":90,"threads_started":1}
I20260808 21:03:43.171228 1798 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39133
I20260808 21:03:43.171320 1798 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:43.171502 1798 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:43.172034 1473 ts_manager.cc:194] Registered new tserver with Master: d2e4cef4da6c4df88b9aa66a8fdf3502 (127.14.146.193:33231)
I20260808 21:03:43.173014 1473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:54901
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:03:43.196835 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:60607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39133
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 21:03:43.294634 1808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:43.295032 1808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:43.295123 1808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:43.296912 1808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:43.297060 1808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:43.297153 1808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:03:43.299028 1808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.146.212:60607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:43.299512 1808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:43.299885 1808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:43.307006 1819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:43.307394 1814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:43.307675 1808 server_base.cc:1034] running on GCE node
W20260808 21:03:43.307394 1815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:43.308094 1808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:43.308420 1808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:43.311780 1808 hybrid_clock.cc:648] HybridClock initialized: now 1786223023311759 us; error 41 us; skew 500 ppm
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:43.315356 1808 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:03:43.315943 1808 webserver.cc:460] Webserver started at http://127.14.146.194:42497/ using document root <none> and password file <none>
I20260808 21:03:43.316253 1808 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:43.316321 1808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:43.316494 1808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:43.329596 1808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "0ad93abe6d37420a95cb9264e9a33aaa"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "e1563fb77b3b1c522afffcf28e86c11d"
server_key_iv: "9b96f0bc1daca99d9405fe19f7e46020"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.330207 1808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "0ad93abe6d37420a95cb9264e9a33aaa"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "e1563fb77b3b1c522afffcf28e86c11d"
server_key_iv: "9b96f0bc1daca99d9405fe19f7e46020"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.332235 1808 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 21:03:43.345338 1827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.345602 1808 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:43.345706 1808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "0ad93abe6d37420a95cb9264e9a33aaa"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "e1563fb77b3b1c522afffcf28e86c11d"
server_key_iv: "9b96f0bc1daca99d9405fe19f7e46020"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.345794 1808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:43.363209 1808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:43.365715 1808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:43.365924 1808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:43.366200 1808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:43.366641 1808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:43.366724 1808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.366786 1808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:43.366829 1808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.373920 1808 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:40525
I20260808 21:03:43.374431 1808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:03:43.375268 1993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:40525 every 8 connection(s)
I20260808 21:03:43.376873 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 1808
I20260808 21:03:43.376979 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:03:43.377173 14923 external_mini_cluster.cc:1428] Setting key cb7c159d5111367800d5d6d8a4aceb37
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:43.387333 1800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:43.376018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:59063 (local address 127.14.146.254:39133)
0808 21:03:43.376089 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:43.376091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:43.376375 (+ 284us) server_negotiation.cc:407] Connection header received
0808 21:03:43.377046 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:43.377047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:43.377064 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:43.377097 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:43.378223 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.378972 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.380464 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.380779 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.380830 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:43.383613 (+ 2783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:43.383614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:43.383615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:43.383623 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:43.385704 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:43.386195 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:43.386197 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:43.386197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:43.386279 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:43.386561 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:43.386562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:43.386562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:43.386699 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:43.386742 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:43.387115 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 21:03:43.387231 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:03:43.388124 1997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:43.375994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39133 (local address 127.14.146.194:59063)
0808 21:03:43.376211 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:43.376261 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:43.376907 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:43.377285 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:43.377290 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:43.377734 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:43.378117 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:43.378124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.379094 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.379095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:43.380349 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:43.380353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.380943 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.380944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:43.381086 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:43.381754 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:43.381765 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:43.383492 (+ 1727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:43.385806 (+ 2314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:43.385813 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:43.385815 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:43.386104 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:43.386356 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:43.386356 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:43.386357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:43.386486 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:43.386790 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:43.386796 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:43.386959 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 21:03:43.387646 (+ 687us) client_negotiation.cc:240] Negotiation successful
0808 21:03:43.387814 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":134,"threads_started":1}
I20260808 21:03:43.388813 1994 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39133
I20260808 21:03:43.388922 1994 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:43.389125 1994 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:43.389523 1473 ts_manager.cc:194] Registered new tserver with Master: 0ad93abe6d37420a95cb9264e9a33aaa (127.14.146.194:40525)
I20260808 21:03:43.390013 1473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:59063
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:03:43.412506 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:60607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39133
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:43.537000 2000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:43.537241 2000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:43.537281 2000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:43.539042 2000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:43.539108 2000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:43.539149 2000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:03:43.541373 2000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.146.212:60607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:43.541640 2000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:43.541905 2000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:43.549851 2008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:43.549955 2010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:43.549844 2007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:43.550751 2000 server_base.cc:1034] running on GCE node
I20260808 21:03:43.551023 2000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:43.551393 2000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:43.552574 2000 hybrid_clock.cc:648] HybridClock initialized: now 1786223023552553 us; error 42 us; skew 500 ppm
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:43.556134 2000 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:03:43.556677 2000 webserver.cc:460] Webserver started at http://127.14.146.195:39047/ using document root <none> and password file <none>
I20260808 21:03:43.556939 2000 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:43.557013 2000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:43.557181 2000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:43.571059 2000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "a6009cf33a94c1f67c62fca024cbdf83"
server_key_iv: "34b8a855b4fbfab0fbc8cf822f63440f"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.571521 2000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "a6009cf33a94c1f67c62fca024cbdf83"
server_key_iv: "34b8a855b4fbfab0fbc8cf822f63440f"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.573598 2000 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 21:03:43.589851 2021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.590099 2000 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:43.590204 2000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "a6009cf33a94c1f67c62fca024cbdf83"
server_key_iv: "34b8a855b4fbfab0fbc8cf822f63440f"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.590329 2000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:43.607446 2000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:43.609969 2000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:43.610141 2000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:43.610396 2000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:43.610756 2000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:43.610806 2000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.610846 2000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:43.610872 2000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.618245 2000 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:41171
I20260808 21:03:43.618357 2189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:41171 every 8 connection(s)
I20260808 21:03:43.618706 2000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:03:43.620380 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 2000
I20260808 21:03:43.620486 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:03:43.620710 14923 external_mini_cluster.cc:1428] Setting key 8c2ab6d910beebdc5648d68a0ee1f5a9
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:43.630064 1800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:43.619869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:41821 (local address 127.14.146.254:39133)
0808 21:03:43.619921 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:43.619925 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:43.620214 (+ 289us) server_negotiation.cc:407] Connection header received
0808 21:03:43.620892 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:43.620894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:43.620909 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:43.620944 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:43.621802 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.622436 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.623425 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.623735 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.623798 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:43.626622 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:43.626624 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:43.626624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:43.626632 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:43.628395 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:43.628900 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:43.628902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:43.628902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:43.628973 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:43.629287 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:43.629288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:43.629288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:43.629430 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:43.629505 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:43.629871 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 21:03:43.629957 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:03:43.630221 2192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:43.619839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39133 (local address 127.14.146.195:41821)
0808 21:03:43.620032 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:43.620101 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:43.620741 (+ 640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:43.621142 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:43.621146 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:43.621394 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:43.621683 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:43.621689 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.622540 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.622541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:43.623328 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:43.623330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:43.623938 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:43.623940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:43.624120 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:43.624693 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:43.624703 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:43.626513 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:43.628486 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:43.628493 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:43.628495 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:43.628811 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:43.629064 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:43.629065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:43.629065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:43.629208 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:43.629514 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:43.629521 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:43.629694 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 21:03:43.629829 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 21:03:43.629989 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
I20260808 21:03:43.630707 2190 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39133
I20260808 21:03:43.630820 2190 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:43.631021 2190 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:43.631392 1473 ts_manager.cc:194] Registered new tserver with Master: cc0feb6661aa4e0a8ba3b4d262ec8685 (127.14.146.195:41171)
I20260808 21:03:43.631888 1473 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:41821
I20260808 21:03:43.635011 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:03:43.635697 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 1590
I20260808 21:03:43.646281 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 1808
I20260808 21:03:43.656495 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 2000
I20260808 21:03:43.674163 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 1424
I20260808 21:03:43.696250 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39133
--webserver_interface=127.14.146.254
--webserver_port=33333
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:39133
--ranger_config_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:60607/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.146.212:60607/kms with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:43.779043 2193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:43.779251 2193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:43.779273 2193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:43.780448 2193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:43.780493 2193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:43.780508 2193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:43.780521 2193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:43.780534 2193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:43.782192 2193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.146.212:60607/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:39133
--ranger_config_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=33333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:43.782429 2193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:43.782673 2193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:43.787796 2205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:43.787765 2200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:43.787766 2202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:43.788038 2193 server_base.cc:1034] running on GCE node
I20260808 21:03:43.788300 2193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:43.788604 2193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:43.789748 2193 hybrid_clock.cc:648] HybridClock initialized: now 1786223023789713 us; error 51 us; skew 500 ppm
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:43.792398 2193 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:03:43.792883 2193 webserver.cc:460] Webserver started at http://127.14.146.254:33333/ using document root <none> and password file <none>
I20260808 21:03:43.793144 2193 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:43.793201 2193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 21:03:43 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223023, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:43.839885 2193 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:43.840811 2218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:43.841100 2193 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:03:43.841236 2193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "5b42511b0c724450beeba7bb86a43565"
format_stamp: "Formatted at 2026-08-08 21:03:42 on dist-test-slave-t3q3"
server_key: "cd059c48615278daf7ac05d4077954b0"
server_key_iv: "f8b55c6fae7a2a88de6f180743b3e813"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:43.841647 2193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:43.860777 2193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:43.862704 2193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:43.862885 2193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:43.867502 2193 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:39133
I20260808 21:03:43.867547 2298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:39133 every 8 connection(s)
I20260808 21:03:43.867946 2193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:03:43.869681 2300 sys_catalog.cc:263] Verifying existing consensus state
I20260808 21:03:43.870376 2300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Bootstrap starting.
I20260808 21:03:43.872597 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 2193
I20260808 21:03:43.872936 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:60607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:33231
--local_ip_for_outbound_sockets=127.14.146.193
--tserver_master_addrs=127.14.146.254:39133
--webserver_port=45925
--webserver_interface=127.14.146.193
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.146.212:60607/kms with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:03:43.878608 2300 log.cc:824] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:43.880544 2300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:03:43.880856 2300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Bootstrap complete.
I20260808 21:03:43.883241 2300 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } }
I20260808 21:03:43.883507 2300 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b42511b0c724450beeba7bb86a43565, State: Initialized, Role: FOLLOWER
I20260808 21:03:43.883733 2300 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } }
I20260808 21:03:43.883836 2300 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:03:43.883891 2300 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:03:43.883940 2300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 1 FOLLOWER]: Advancing to term 2
I20260808 21:03:43.885028 2300 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } }
I20260808 21:03:43.885156 2300 leader_election.cc:302] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b42511b0c724450beeba7bb86a43565; no voters:
I20260808 21:03:43.885377 2300 leader_election.cc:288] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 21:03:43.885418 2308 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 21:03:43.885540 2308 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [term 2 LEADER]: Becoming Leader. State: Replica: 5b42511b0c724450beeba7bb86a43565, State: Running, Role: LEADER
I20260808 21:03:43.885636 2308 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } }
I20260808 21:03:43.885669 2300 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:03:43.885923 2310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5b42511b0c724450beeba7bb86a43565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } } }
I20260808 21:03:43.886020 2310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:43.886201 2311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b42511b0c724450beeba7bb86a43565. Latest consensus state: current_term: 2 leader_uuid: "5b42511b0c724450beeba7bb86a43565" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b42511b0c724450beeba7bb86a43565" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39133 } } }
I20260808 21:03:43.886245 2313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:03:43.886858 2313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:03:43.887013 2313 catalog_manager.cc:1259] Loaded cluster ID: 54959c16c56442b5a7e6440e047b3adf
I20260808 21:03:43.887061 2313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:03:43.887223 2300 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 21:03:43.886262 2311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:43.891458 2313 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:03:43.892161 2313 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Loaded TSK: 0
I20260808 21:03:43.892552 2313 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 21:03:43.989292 2304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:43.989552 2304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:43.989588 2304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:43.991163 2304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:43.991231 2304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:43.991271 2304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:03:43.993449 2304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.146.212:60607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:33231
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=45925
--tserver_master_addrs=127.14.146.254:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:43.993690 2304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:43.993958 2304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:44.001607 2356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:44.001598 2358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:44.002185 2355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:44.002487 2304 server_base.cc:1034] running on GCE node
I20260808 21:03:44.002800 2304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:44.003088 2304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:44.004253 2304 hybrid_clock.cc:648] HybridClock initialized: now 1786223024004225 us; error 41 us; skew 500 ppm
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:44.007660 2304 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:03:44.008241 2304 webserver.cc:460] Webserver started at http://127.14.146.193:45925/ using document root <none> and password file <none>
I20260808 21:03:44.008541 2304 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:44.008631 2304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:44.030707 2304 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s
I20260808 21:03:44.035818 2373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.036340 2304 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.001s
I20260808 21:03:44.036482 2304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "cab752670cbf3e0f35a27b2a08e271b9"
server_key_iv: "94ea0e7820cd13422dd4a01c799c7b77"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:44.036890 2304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:44.052217 2304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:44.054425 2304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:44.054608 2304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:44.054901 2304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:44.055297 2304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:44.055346 2304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.055375 2304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:44.055393 2304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.063623 2304 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:33231
I20260808 21:03:44.064052 2304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:03:44.064772 2546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:33231 every 8 connection(s)
I20260808 21:03:44.070194 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 2304
I20260808 21:03:44.070516 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:60607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:40525
--local_ip_for_outbound_sockets=127.14.146.194
--tserver_master_addrs=127.14.146.254:39133
--webserver_port=42497
--webserver_interface=127.14.146.194
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.146.212:60607/kms with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:44.081043 2556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:44.065960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39133 (local address 127.14.146.193:37905)
0808 21:03:44.068197 (+ 2237us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:44.068241 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:44.068705 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:44.069423 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:44.069427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:44.069635 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:44.069833 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:44.069838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.071938 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.071939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:44.073305 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:44.073308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.074279 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.074281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:44.074426 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:44.075055 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:44.075065 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:44.076674 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:44.079085 (+ 2411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:44.079092 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:44.079094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:44.079390 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:44.079669 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:44.079671 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:44.079671 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:44.079816 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:44.080386 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:44.080393 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:44.080546 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 21:03:44.080647 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 21:03:44.080806 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2182,"thread_start_us":87,"threads_started":1}
I20260808 21:03:44.081733 2557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:44.066246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:37905 (local address 127.14.146.254:39133)
0808 21:03:44.068942 (+ 2696us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:44.068951 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:44.068996 (+ 45us) server_negotiation.cc:407] Connection header received
0808 21:03:44.069156 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:44.069163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:44.069221 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:44.069371 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:44.069956 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.071812 (+ 1856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.073410 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.074052 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.074160 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:44.076814 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:44.076818 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:44.076819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:44.076830 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:44.078987 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:44.079492 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:44.079495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:44.079496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:44.079605 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:44.079901 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:44.079902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:44.079902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:44.080266 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:44.080354 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:44.081403 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0808 21:03:44.081532 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2637,"thread_start_us":92,"threads_started":1}
I20260808 21:03:44.082410 2547 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39133
I20260808 21:03:44.082515 2547 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.082715 2547 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
W20260808 21:03:44.083580 2547 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:39133 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 21:03:44.083665 2547 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.083737 2547 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:44.084053 2547 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.084160 2547 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
W20260808 21:03:44.084491 2547 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 21:03:44.192041 2559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:44.192337 2559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:44.192374 2559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:44.193751 2559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:44.193815 2559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:44.193859 2559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:03:44.195348 2559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.146.212:60607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:40525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=42497
--tserver_master_addrs=127.14.146.254:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:44.195607 2559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:44.195914 2559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:44.201329 2573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:44.201464 2575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:44.201359 2570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:44.202805 2559 server_base.cc:1034] running on GCE node
I20260808 21:03:44.203069 2559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:44.203341 2559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:44.204537 2559 hybrid_clock.cc:648] HybridClock initialized: now 1786223024204518 us; error 33 us; skew 500 ppm
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:44.208148 2559 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:03:44.208767 2559 webserver.cc:460] Webserver started at http://127.14.146.194:42497/ using document root <none> and password file <none>
I20260808 21:03:44.209086 2559 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:44.209177 2559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:44.234879 2559 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:44.235561 2584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.235702 2559 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.235772 2559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "0ad93abe6d37420a95cb9264e9a33aaa"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "e1563fb77b3b1c522afffcf28e86c11d"
server_key_iv: "9b96f0bc1daca99d9405fe19f7e46020"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:44.237046 2559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:44.259660 2559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:44.262288 2559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:44.262454 2559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:44.262723 2559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:44.263123 2559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:44.263177 2559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.263221 2559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:44.263247 2559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.270462 2559 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:40525
I20260808 21:03:44.270733 2749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:40525 every 8 connection(s)
I20260808 21:03:44.270924 2559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:03:44.280726 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 2559
I20260808 21:03:44.281430 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.146.212:60607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:41171
--local_ip_for_outbound_sockets=127.14.146.195
--tserver_master_addrs=127.14.146.254:39133
--webserver_port=39047
--webserver_interface=127.14.146.195
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.146.212:60607/kms with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:44.287808 2557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:44.271757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:59923 (local address 127.14.146.254:39133)
0808 21:03:44.271826 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:44.271829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:44.272097 (+ 268us) server_negotiation.cc:407] Connection header received
0808 21:03:44.276491 (+ 4394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:44.276493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:44.276507 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:44.276540 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:44.277395 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.278208 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.279904 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.280307 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.280356 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:44.284189 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:44.284190 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:44.284191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:44.284199 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:44.285948 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:44.286601 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:44.286602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:44.286603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:44.286664 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:44.286933 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:44.286934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:44.286934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:44.287087 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:44.287131 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:44.287610 (+ 479us) server_negotiation.cc:299] Negotiation successful
0808 21:03:44.287707 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 21:03:44.288671 2753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:44.271733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39133 (local address 127.14.146.194:59923)
0808 21:03:44.271922 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:44.271975 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:44.276342 (+ 4367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:44.276730 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:44.276735 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:44.276975 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:44.277272 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:44.277278 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.278333 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.278334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:44.279657 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:44.279660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.280478 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.280480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:44.280630 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:44.282294 (+ 1664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:44.282305 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:44.284026 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:44.286069 (+ 2043us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:44.286076 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:44.286079 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:44.286510 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:44.286734 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:44.286735 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:44.286735 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:44.286860 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:44.287225 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:44.287232 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:44.287446 (+ 214us) client_negotiation.cc:769] Sending connection context
0808 21:03:44.288254 (+ 808us) client_negotiation.cc:240] Negotiation successful
0808 21:03:44.288432 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
I20260808 21:03:44.289372 2750 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39133
I20260808 21:03:44.289471 2750 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.289659 2750 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
W20260808 21:03:44.290377 2750 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:39133 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 21:03:44.290447 2750 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.290506 2750 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:44.290858 2750 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.290930 2750 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
W20260808 21:03:44.291260 2750 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 21:03:44.403118 2755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:44.403432 2755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:44.403465 2755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:44.405136 2755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:44.405196 2755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:44.405236 2755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:03:44.407284 2755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.146.212:60607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:41171
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=39047
--tserver_master_addrs=127.14.146.254:39133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:44.407526 2755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:44.407783 2755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:44.414268 2761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:44.414358 2768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:44.414685 2755 server_base.cc:1034] running on GCE node
W20260808 21:03:44.415838 2762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:44.416230 2755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:44.416518 2755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:44.417694 2755 hybrid_clock.cc:648] HybridClock initialized: now 1786223024417673 us; error 41 us; skew 500 ppm
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:44.420943 2755 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:03:44.421525 2755 webserver.cc:460] Webserver started at http://127.14.146.195:39047/ using document root <none> and password file <none>
I20260808 21:03:44.421820 2755 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:44.421917 2755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:44.444931 2755 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 21:03:44.445986 2779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.446156 2755 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:03:44.446259 2755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685"
format_stamp: "Formatted at 2026-08-08 21:03:43 on dist-test-slave-t3q3"
server_key: "a6009cf33a94c1f67c62fca024cbdf83"
server_key_iv: "34b8a855b4fbfab0fbc8cf822f63440f"
server_key_version: "kuduclusterkey@0"
I20260808 21:03:44.447860 2755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:44.470449 2755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:44.473075 2755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:44.473266 2755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:44.473511 2755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:44.473954 2755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:44.474010 2755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.474049 2755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:44.474074 2755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:44.480937 2755 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:41171
I20260808 21:03:44.481122 2956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:41171 every 8 connection(s)
I20260808 21:03:44.481426 2755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
Aug 08 21:03:44 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223024, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:44.490506 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 2755
I20260808 21:03:44.492710 2557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:44.482287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:48663 (local address 127.14.146.254:39133)
0808 21:03:44.482364 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:44.482366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:44.482570 (+ 204us) server_negotiation.cc:407] Connection header received
0808 21:03:44.483419 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:44.483420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:44.483434 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:44.483514 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:44.484118 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.484901 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.486071 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.486374 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.486459 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:44.488892 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:44.488894 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:44.488894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:44.488903 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:44.490489 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:44.491478 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:44.491479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:44.491479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:44.491550 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:44.491902 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:44.491903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:44.491903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:44.492083 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:44.492188 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:44.492521 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 21:03:44.492606 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 21:03:44.492913 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:44.482212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39133 (local address 127.14.146.195:48663)
0808 21:03:44.482417 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:44.482462 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:44.482930 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:44.483591 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:44.483594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:44.483779 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:44.483985 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:44.483989 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.485010 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.485010 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:44.485974 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:44.485977 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.486485 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.486486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:44.486680 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:44.487345 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:44.487355 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:44.488789 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:44.490928 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:44.490934 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:44.490935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:44.491401 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:44.491647 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:44.491648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:44.491648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:44.491810 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:44.492203 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:44.492211 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:44.492375 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 21:03:44.492495 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 21:03:44.492657 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260808 21:03:44.494081 2957 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39133
I20260808 21:03:44.494199 2957 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.494433 2957 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
W20260808 21:03:44.495136 2957 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:39133 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 21:03:44.495220 2957 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.495286 2957 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:44.495599 2957 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:44.495683 2957 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
W20260808 21:03:44.496007 2957 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 21:03:44.501345 2963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:44.491169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36106 (local address 127.14.146.254:39133)
0808 21:03:44.491496 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:44.491498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:44.491504 (+ 6us) server_negotiation.cc:407] Connection header received
0808 21:03:44.491523 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:44.491523 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:44.491533 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:44.491615 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:44.492281 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.493316 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.496126 (+ 2810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:44.496440 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:44.496522 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:44.498101 (+ 1579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:44.498103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:44.498103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:44.498110 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:44.499991 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:44.500431 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:44.500432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:44.500433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:44.500503 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:44.500765 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:44.500766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:44.500766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:44.500911 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:44.501101 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:44.501143 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 21:03:44.501236 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":73,"threads_started":1}
Aug 08 21:03:45 dist-test-slave-t3q3 krb5kdc[742](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786223025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:45.084698 2547 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:45.084892 2547 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:45.085388 2246 ts_manager.cc:194] Registered new tserver with Master: d2e4cef4da6c4df88b9aa66a8fdf3502 (127.14.146.193:33231)
I20260808 21:03:45.086508 2246 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:37905
I20260808 21:03:45.291446 2750 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:45.291613 2750 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:45.291996 2246 ts_manager.cc:194] Registered new tserver with Master: 0ad93abe6d37420a95cb9264e9a33aaa (127.14.146.194:40525)
I20260808 21:03:45.292584 2246 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:59923
Aug 08 21:03:45 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:45.496201 2957 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:45.496361 2957 heartbeater.cc:511] Master 127.14.146.254:39133 requested a full tablet report, sending...
I20260808 21:03:45.496641 2246 ts_manager.cc:194] Registered new tserver with Master: cc0feb6661aa4e0a8ba3b4d262ec8685 (127.14.146.195:41171)
I20260808 21:03:45.497062 2246 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:48663
I20260808 21:03:45.505347 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:03:45.512975 2996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.506352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36108 (local address 127.14.146.254:39133)
0808 21:03:45.506474 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:45.506476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:45.506542 (+ 66us) server_negotiation.cc:407] Connection header received
0808 21:03:45.506620 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:45.506621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:45.506633 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:45.506702 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:45.507263 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.507772 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.508586 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.508811 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.508888 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.510162 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:45.510163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:45.510164 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:45.510171 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:45.511699 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:45.512088 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:45.512089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:45.512090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:45.512152 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:45.512367 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:45.512368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:45.512368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:45.512482 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:45.512592 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:45.512694 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 21:03:45.512785 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":75,"threads_started":1}
I20260808 21:03:45.514961 2246 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:03:45.516781 2246 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:03:45.525166 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.519667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:33231 (local address 127.0.0.1:56860)
0808 21:03:45.520873 (+ 1206us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:45.520883 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:45.520932 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:45.521221 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:45.521223 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:45.521225 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:45.521260 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.521261 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.522427 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.522428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.523762 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.523765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.524846 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.524847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.524926 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.524941 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 21:03:45.525009 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 21:03:45.525064 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1187,"mutex_wait_us":156,"thread_start_us":88,"threads_started":1}
I20260808 21:03:45.525626 3012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.520125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58168 (local address 127.14.146.194:40525)
0808 21:03:45.520297 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:45.520302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:45.520604 (+ 302us) server_negotiation.cc:407] Connection header received
0808 21:03:45.520648 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:45.520650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:45.520664 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:45.520754 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:45.520928 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.522019 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.523864 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.525080 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.525143 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.525191 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:45.525510 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 21:03:45.525554 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":59,"threads_started":1}
I20260808 21:03:45.525816 3008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.519939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56860 (local address 127.14.146.193:33231)
0808 21:03:45.520116 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:45.520122 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:45.520997 (+ 875us) server_negotiation.cc:407] Connection header received
0808 21:03:45.521034 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:45.521037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:45.521052 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:45.521120 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:45.521336 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.522341 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.523871 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.524670 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.524718 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.524782 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:45.525560 (+ 778us) server_negotiation.cc:299] Negotiation successful
0808 21:03:45.525605 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":59,"threads_started":1}
I20260808 21:03:45.525449 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.519667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:40525 (local address 127.0.0.1:58168)
0808 21:03:45.520412 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:45.520453 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:45.520520 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:45.520757 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:45.520760 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:45.520762 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:45.520836 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.520838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.522112 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.522113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.523762 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.523765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.525228 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.525229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.525301 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.525305 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:03:45.525353 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 21:03:45.525387 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":5,"thread_start_us":87,"threads_started":1}
I20260808 21:03:45.526643 2450 tablet_service.cc:1467] Processing CreateTablet for tablet cab1b1a8307d4a12af7dd4437c0a10e8 (DEFAULT_TABLE table=test-table [id=f7d1c02943c54725b4e1d976ec6b22de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:45.527024 2450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab1b1a8307d4a12af7dd4437c0a10e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:45.526893 2650 tablet_service.cc:1467] Processing CreateTablet for tablet cab1b1a8307d4a12af7dd4437c0a10e8 (DEFAULT_TABLE table=test-table [id=f7d1c02943c54725b4e1d976ec6b22de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:45.527285 2650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab1b1a8307d4a12af7dd4437c0a10e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:45.530992 3017 tablet_bootstrap.cc:492] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: Bootstrap starting.
I20260808 21:03:45.531688 3017 tablet_bootstrap.cc:654] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:45.532025 3017 log.cc:824] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:45.532398 3016 tablet_bootstrap.cc:492] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502: Bootstrap starting.
I20260808 21:03:45.533144 3016 tablet_bootstrap.cc:654] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:45.533576 3016 log.cc:824] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:45.534394 3017 tablet_bootstrap.cc:492] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: No bootstrap required, opened a new log
I20260808 21:03:45.534511 3017 ts_tablet_manager.cc:1397] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 21:03:45.536496 3006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.519900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41171 (local address 127.0.0.1:37774)
0808 21:03:45.522629 (+ 2729us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:45.522640 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:45.522686 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:45.532364 (+ 9678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:45.532366 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:45.532368 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:45.532417 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.532419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.533704 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.533705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.534875 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.534879 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.536250 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.536251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.536317 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.536322 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:03:45.536371 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 21:03:45.536414 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2712,"thread_start_us":75,"threads_started":1}
I20260808 21:03:45.536798 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.520010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37774 (local address 127.14.146.195:41171)
0808 21:03:45.532155 (+ 12145us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:45.532160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:45.532173 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:03:45.532212 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:45.532214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:45.532232 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:45.532333 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:45.532508 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.533604 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.535271 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.536031 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.536151 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.536212 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:45.536663 (+ 451us) server_negotiation.cc:299] Negotiation successful
0808 21:03:45.536709 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12102,"thread_start_us":80,"threads_started":1}
I20260808 21:03:45.537554 2852 tablet_service.cc:1467] Processing CreateTablet for tablet cab1b1a8307d4a12af7dd4437c0a10e8 (DEFAULT_TABLE table=test-table [id=f7d1c02943c54725b4e1d976ec6b22de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:45.537632 3017 raft_consensus.cc:348] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.537803 3017 raft_consensus.cc:374] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:45.537843 3017 raft_consensus.cc:729] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad93abe6d37420a95cb9264e9a33aaa, State: Initialized, Role: FOLLOWER
I20260808 21:03:45.537910 2852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cab1b1a8307d4a12af7dd4437c0a10e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:45.537989 3017 consensus_queue.cc:260] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.538268 3017 ts_tablet_manager.cc:1428] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 21:03:45.538379 2750 heartbeater.cc:503] Master 127.14.146.254:39133 was elected leader, sending a full tablet report...
I20260808 21:03:45.539849 3016 tablet_bootstrap.cc:492] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502: No bootstrap required, opened a new log
I20260808 21:03:45.539917 3016 ts_tablet_manager.cc:1397] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260808 21:03:45.542846 3016 raft_consensus.cc:348] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.543031 3016 raft_consensus.cc:374] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:45.543081 3016 raft_consensus.cc:729] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2e4cef4da6c4df88b9aa66a8fdf3502, State: Initialized, Role: FOLLOWER
I20260808 21:03:45.543265 3016 consensus_queue.cc:260] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.543572 3016 ts_tablet_manager.cc:1428] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 21:03:45.543705 2547 heartbeater.cc:503] Master 127.14.146.254:39133 was elected leader, sending a full tablet report...
I20260808 21:03:45.548339 3023 tablet_bootstrap.cc:492] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: Bootstrap starting.
I20260808 21:03:45.549134 3023 tablet_bootstrap.cc:654] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:45.549455 3023 log.cc:824] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:45.550344 3023 tablet_bootstrap.cc:492] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: No bootstrap required, opened a new log
I20260808 21:03:45.550414 3023 ts_tablet_manager.cc:1397] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:03:45.553071 3023 raft_consensus.cc:348] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.553257 3023 raft_consensus.cc:374] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:45.553289 3023 raft_consensus.cc:729] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc0feb6661aa4e0a8ba3b4d262ec8685, State: Initialized, Role: FOLLOWER
I20260808 21:03:45.553442 3023 consensus_queue.cc:260] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.553736 2957 heartbeater.cc:503] Master 127.14.146.254:39133 was elected leader, sending a full tablet report...
I20260808 21:03:45.553725 3023 ts_tablet_manager.cc:1428] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260808 21:03:45.566439 2550 tablet.cc:2369] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:03:45.593065 3027 raft_consensus.cc:482] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:03:45.593353 3027 raft_consensus.cc:504] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.594275 3027 leader_election.cc:288] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2e4cef4da6c4df88b9aa66a8fdf3502 (127.14.146.193:33231), 0ad93abe6d37420a95cb9264e9a33aaa (127.14.146.194:40525)
I20260808 21:03:45.598192 3012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.594328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:34449 (local address 127.14.146.194:40525)
0808 21:03:45.594446 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:45.594448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:45.594637 (+ 189us) server_negotiation.cc:407] Connection header received
0808 21:03:45.594747 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:45.594749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:45.594758 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:45.594789 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:45.595019 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.595718 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.597171 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.597751 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.597808 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.597818 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:45.598067 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 21:03:45.598116 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 21:03:45.598664 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.594044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:40525 (local address 127.14.146.195:34449)
0808 21:03:45.594571 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:45.594581 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:45.594666 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:45.594863 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:45.594864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:45.594866 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:45.594935 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.594937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.595825 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.595826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.597056 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.597060 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.597901 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.597902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.597972 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.597976 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:03:45.598490 (+ 514us) client_negotiation.cc:240] Negotiation successful
0808 21:03:45.598556 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":20,"thread_start_us":130,"threads_started":1}
I20260808 21:03:45.599134 2687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab1b1a8307d4a12af7dd4437c0a10e8" candidate_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" is_pre_election: true
I20260808 21:03:45.599330 2687 raft_consensus.cc:2454] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc0feb6661aa4e0a8ba3b4d262ec8685 in term 0.
I20260808 21:03:45.599694 2786 leader_election.cc:302] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad93abe6d37420a95cb9264e9a33aaa, cc0feb6661aa4e0a8ba3b4d262ec8685; no voters:
I20260808 21:03:45.599848 3027 raft_consensus.cc:2781] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:03:45.599905 3027 raft_consensus.cc:482] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:03:45.599932 3027 raft_consensus.cc:3037] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:45.600920 3027 raft_consensus.cc:504] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.601073 3027 leader_election.cc:288] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [CANDIDATE]: Term 1 election: Requested vote from peers d2e4cef4da6c4df88b9aa66a8fdf3502 (127.14.146.193:33231), 0ad93abe6d37420a95cb9264e9a33aaa (127.14.146.194:40525)
I20260808 21:03:45.601257 2687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab1b1a8307d4a12af7dd4437c0a10e8" candidate_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad93abe6d37420a95cb9264e9a33aaa"
I20260808 21:03:45.601344 2687 raft_consensus.cc:3037] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:45.601563 3008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.594397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:40343 (local address 127.14.146.193:33231)
0808 21:03:45.594482 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:45.594484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:45.594518 (+ 34us) server_negotiation.cc:407] Connection header received
0808 21:03:45.594548 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:45.594548 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:45.594557 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:45.594602 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:45.594898 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.595617 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.598558 (+ 2941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.599149 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.599199 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.599206 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:45.601429 (+ 2223us) server_negotiation.cc:299] Negotiation successful
0808 21:03:45.601481 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 21:03:45.601765 3030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.594040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:33231 (local address 127.14.146.195:40343)
0808 21:03:45.594406 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:45.594418 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:45.594477 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:45.594724 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:45.594725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:45.594727 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:45.594807 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.594810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.595742 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.595742 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.597066 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:45.597070 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.601255 (+ 4185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.601255 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:45.601332 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.601336 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:03:45.601638 (+ 302us) client_negotiation.cc:240] Negotiation successful
0808 21:03:45.601686 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":1,"thread_start_us":139,"threads_started":1}
I20260808 21:03:45.602221 2687 raft_consensus.cc:2454] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc0feb6661aa4e0a8ba3b4d262ec8685 in term 1.
I20260808 21:03:45.602182 2480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab1b1a8307d4a12af7dd4437c0a10e8" candidate_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" is_pre_election: true
I20260808 21:03:45.602325 2480 raft_consensus.cc:2454] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc0feb6661aa4e0a8ba3b4d262ec8685 in term 0.
I20260808 21:03:45.602417 2786 leader_election.cc:302] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad93abe6d37420a95cb9264e9a33aaa, cc0feb6661aa4e0a8ba3b4d262ec8685; no voters:
I20260808 21:03:45.602437 2479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cab1b1a8307d4a12af7dd4437c0a10e8" candidate_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502"
I20260808 21:03:45.602484 2479 raft_consensus.cc:3037] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:45.602509 3027 raft_consensus.cc:2781] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:03:45.602653 3027 raft_consensus.cc:686] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 1 LEADER]: Becoming Leader. State: Replica: cc0feb6661aa4e0a8ba3b4d262ec8685, State: Running, Role: LEADER
I20260808 21:03:45.602756 3027 consensus_queue.cc:237] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } }
I20260808 21:03:45.603303 2479 raft_consensus.cc:2454] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc0feb6661aa4e0a8ba3b4d262ec8685 in term 1.
I20260808 21:03:45.603597 2246 catalog_manager.cc:5495] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc0feb6661aa4e0a8ba3b4d262ec8685 (127.14.146.195). New cstate: current_term: 1 leader_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc0feb6661aa4e0a8ba3b4d262ec8685" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41171 } health_report { overall_health: HEALTHY } } }
I20260808 21:03:45.616990 3009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.613810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37780 (local address 127.14.146.195:41171)
0808 21:03:45.613850 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:45.613851 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:45.613860 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:03:45.613896 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:45.613897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:45.613917 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:45.613978 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:03:45.614152 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.614877 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.616032 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:45.616330 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:45.616415 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:45.616618 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:03:45.616753 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:03:45.616854 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:45.616882 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 21:03:45.616910 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:03:45.619340 2479 raft_consensus.cc:1261] T cab1b1a8307d4a12af7dd4437c0a10e8 P d2e4cef4da6c4df88b9aa66a8fdf3502 [term 1 FOLLOWER]: Refusing update from remote peer cc0feb6661aa4e0a8ba3b4d262ec8685: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:03:45.619671 2687 raft_consensus.cc:1261] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 1 FOLLOWER]: Refusing update from remote peer cc0feb6661aa4e0a8ba3b4d262ec8685: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:03:45.620019 3027 consensus_queue.cc:1035] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2e4cef4da6c4df88b9aa66a8fdf3502" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 33231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:03:45.620265 3031 consensus_queue.cc:1035] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad93abe6d37420a95cb9264e9a33aaa" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 40525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:03:45.624531 3041 mvcc.cc:205] Tried to move back new op lower bound from 7316369512933457920 to 7316369512869449728. Current Snapshot: MvccSnapshot[applied={T|T < 7316369512933457920}]
I20260808 21:03:45.624665 3039 mvcc.cc:205] Tried to move back new op lower bound from 7316369512933457920 to 7316369512869449728. Current Snapshot: MvccSnapshot[applied={T|T < 7316369512933457920}]
I20260808 21:03:45.628494 2246 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:03:45.628623 2246 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:03:45.629400 2246 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b42511b0c724450beeba7bb86a43565: Sending DeleteTablet for 3 replicas of tablet cab1b1a8307d4a12af7dd4437c0a10e8
I20260808 21:03:45.630061 2450 tablet_service.cc:1514] Processing DeleteTablet for tablet cab1b1a8307d4a12af7dd4437c0a10e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:45 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:56860
I20260808 21:03:45.630328 2650 tablet_service.cc:1514] Processing DeleteTablet for tablet cab1b1a8307d4a12af7dd4437c0a10e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:45 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:58168
I20260808 21:03:45.630545 2852 tablet_service.cc:1514] Processing DeleteTablet for tablet cab1b1a8307d4a12af7dd4437c0a10e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:45 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:37774
I20260808 21:03:45.631065 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 2304
Aug 08 21:03:45 dist-test-slave-t3q3 krb5kdc[742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223025, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for HTTP/127.14.146.212@KRBTEST.COM
I20260808 21:03:45.663431 3056 tablet_replica.cc:330] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: stopping tablet replica
I20260808 21:03:45.668864 3056 raft_consensus.cc:2229] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:03:45.669160 3056 raft_consensus.cc:2258] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:03:45.669440 3058 tablet_replica.cc:330] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: stopping tablet replica
I20260808 21:03:45.670040 3056 ts_tablet_manager.cc:1905] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:03:45.671506 3058 raft_consensus.cc:2229] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:03:45.671741 3058 raft_consensus.cc:2258] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:03:45.672753 3058 ts_tablet_manager.cc:1905] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:03:45.674613 3056 ts_tablet_manager.cc:1918] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:03:45.676386 3058 ts_tablet_manager.cc:1918] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:03:45.676527 3056 log.cc:1196] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/cab1b1a8307d4a12af7dd4437c0a10e8
I20260808 21:03:45.676911 3056 ts_tablet_manager.cc:1939] T cab1b1a8307d4a12af7dd4437c0a10e8 P 0ad93abe6d37420a95cb9264e9a33aaa: Deleting consensus metadata
I20260808 21:03:45.677052 3058 log.cc:1196] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/cab1b1a8307d4a12af7dd4437c0a10e8
I20260808 21:03:45.677400 3058 ts_tablet_manager.cc:1939] T cab1b1a8307d4a12af7dd4437c0a10e8 P cc0feb6661aa4e0a8ba3b4d262ec8685: Deleting consensus metadata
I20260808 21:03:45.677958 2223 catalog_manager.cc:4841] TS 0ad93abe6d37420a95cb9264e9a33aaa (127.14.146.194:40525): tablet cab1b1a8307d4a12af7dd4437c0a10e8 (table test-table [id=f7d1c02943c54725b4e1d976ec6b22de]) successfully deleted
I20260808 21:03:45.678296 2223 catalog_manager.cc:4841] TS cc0feb6661aa4e0a8ba3b4d262ec8685 (127.14.146.195:41171): tablet cab1b1a8307d4a12af7dd4437c0a10e8 (table test-table [id=f7d1c02943c54725b4e1d976ec6b22de]) successfully deleted
W20260808 21:03:45.678829 2222 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:33231 (error 108)
I20260808 21:03:45.679170 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 2559
I20260808 21:03:45.707425 3006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.707226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:33231 (local address 127.0.0.1:56864)
0808 21:03:45.707305 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:45.707364 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 21:03:45.707625 2222 catalog_manager.cc:4584] TS d2e4cef4da6c4df88b9aa66a8fdf3502 (127.14.146.193:33231): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cab1b1a8307d4a12af7dd4437c0a10e8: Network error: Client connection negotiation failed: client connection to 127.14.146.193:33231: connect: Connection refused (error 111)
I20260808 21:03:45.744637 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 2755
I20260808 21:03:45.761236 3006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.761095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:33231 (local address 127.0.0.1:56870)
0808 21:03:45.761148 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:45.761177 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 21:03:45.761502 3006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:45.761440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:33231 (local address 127.0.0.1:56876)
0808 21:03:45.761465 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:45.761482 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 21:03:45.785926 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 2193
I20260808 21:03:45.801244 14923 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 21:03:46.150990 14923 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 21:03:46.151082 14923 mini_ranger.cc:66] Stopping Ranger...
I20260808 21:03:46.496007 14923 mini_ranger.cc:68] Stopped Ranger
2026-08-08 21:03:46.496 UTC [798] LOG: received smart shutdown request
2026-08-08 21:03:46.500 UTC [798] LOG: background worker "logical replication launcher" (PID 810) exited with exit code 1
2026-08-08 21:03:46.500 UTC [802] LOG: shutting down
2026-08-08 21:03:46.656 UTC [798] LOG: database system is shut down
2026-08-08T21:03:46Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48599 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:03:46 dist-test-slave-t3q3 krb5kdc[3079](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:03:46 dist-test-slave-t3q3 krb5kdc[3079](info): set up 2 sockets
Aug 08 21:03:46 dist-test-slave-t3q3 krb5kdc[3079](info): commencing operation
krb5kdc: starting...
W20260808 21:03:48.016793 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:03:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:03:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:03:48.141045 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45343
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:35181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45343,127.14.146.253:45653,127.14.146.252:46197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:48.225428 3099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:48.225689 3099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:48.225730 3099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:48.226872 3099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:48.226946 3099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:48.226971 3099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:48.226994 3099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:48.227021 3099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:48.228578 3099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45343,127.14.146.253:45653,127.14.146.252:46197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:48.228878 3099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:48.229120 3099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:48.234329 3107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:48.234329 3106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:48.234328 3110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:48.234638 3099 server_base.cc:1034] running on GCE node
I20260808 21:03:48.234910 3099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:48.235229 3099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:48.236397 3099 hybrid_clock.cc:648] HybridClock initialized: now 1786223028236369 us; error 47 us; skew 500 ppm
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:48.241904 3099 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:03:48.242403 3099 webserver.cc:460] Webserver started at http://127.14.146.254:36035/ using document root <none> and password file <none>
I20260808 21:03:48.242646 3099 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:48.242725 3099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:48.242880 3099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:03:48.244011 3099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "f2570657cccb4c7e9533955a04f99ec8"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "81240715bbb71ee3f7151129b083219a"
server_key_iv: "d5f7e672b887d505c2dd6d78c8a8fc06"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.244460 3099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "f2570657cccb4c7e9533955a04f99ec8"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "81240715bbb71ee3f7151129b083219a"
server_key_iv: "d5f7e672b887d505c2dd6d78c8a8fc06"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.245851 3099 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:48.246654 3118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:48.246867 3099 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:48.246976 3099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "f2570657cccb4c7e9533955a04f99ec8"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "81240715bbb71ee3f7151129b083219a"
server_key_iv: "d5f7e672b887d505c2dd6d78c8a8fc06"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.247061 3099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:48.286931 3099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:48.289708 3099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:48.289899 3099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:48.295544 3099 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:45343
I20260808 21:03:48.295603 3193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:45343 every 8 connection(s)
I20260808 21:03:48.296135 3099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:03:48.297367 3194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:48.297520 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 3099
I20260808 21:03:48.297636 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:03:48.297878 14923 external_mini_cluster.cc:1428] Setting key ab0e2d3f919d34c9dd3f3b039aa90bb0
I20260808 21:03:48.300000 3194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.146.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.253@KRBTEST.COM" created.
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:48.314939 3199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.301218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35832 (local address 127.14.146.254:45343)
0808 21:03:48.302164 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.302169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.302188 (+ 19us) server_negotiation.cc:407] Connection header received
0808 21:03:48.302281 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.302283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.302306 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.303312 (+ 1006us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.303359 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.304866 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.305805 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.306351 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.306477 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.311319 (+ 4842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.311327 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.311327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.311335 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.313148 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.313588 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.313592 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.313592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.313680 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.313920 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.313921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.313922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.314228 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.314326 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.314544 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.314676 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":912,"thread_start_us":70,"threads_started":1}
I20260808 21:03:48.314940 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.300977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45343 (local address 127.0.0.1:35832)
0808 21:03:48.301170 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.301214 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.301948 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.302432 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.302436 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.302869 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.303205 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.303213 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.304973 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.304974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.305704 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.305706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.306459 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.306459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.306518 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.307088 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.307098 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.311202 (+ 4104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.313263 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.313270 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.313272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.313477 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.313752 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.313753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.313753 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.313849 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.314315 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.314321 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.314389 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.314510 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.314741 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":80,"thread_start_us":110,"threads_started":1}
I20260808 21:03:48.315869 3194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:03:48.316495 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.316182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56590)
0808 21:03:48.316224 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.316468 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 21:03:48.316674 3120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
I20260808 21:03:48.317145 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.317073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56594)
0808 21:03:48.317101 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.317128 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 21:03:48.317256 3194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:45653: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab.
Entry for principal kudu/127.14.146.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab.
I20260808 21:03:48.329125 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.253:45653
--webserver_interface=127.14.146.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab
--principal=kudu/127.14.146.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:35181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45343,127.14.146.253:45653,127.14.146.252:46197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:03:48.366487 3194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } attempt: 1
I20260808 21:03:48.366989 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.366850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56596)
0808 21:03:48.366919 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.366958 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 21:03:48.367384 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.367281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56604)
0808 21:03:48.367334 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.367364 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 21:03:48.367496 3194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:45653: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
W20260808 21:03:48.413751 3202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:48.414004 3202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:48.414047 3202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:48.415184 3202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:48.415254 3202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:48.415279 3202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:48.415302 3202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:48.415331 3202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:48.416836 3202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45343,127.14.146.253:45653,127.14.146.252:46197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab
--principal=kudu/127.14.146.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.253:45653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.146.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:48.417140 3202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:48.417361 3202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:48.422211 3208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:48.422242 3212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:48.422381 3209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:48.422297 3202 server_base.cc:1034] running on GCE node
I20260808 21:03:48.422700 3202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:48.422998 3202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:48.424124 3202 hybrid_clock.cc:648] HybridClock initialized: now 1786223028424095 us; error 38 us; skew 500 ppm
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:48.426592 3202 init.cc:377] Logged in from keytab as kudu/127.14.146.253@KRBTEST.COM (short username kudu)
I20260808 21:03:48.427011 3202 webserver.cc:460] Webserver started at http://127.14.146.253:41031/ using document root <none> and password file <none>
I20260808 21:03:48.427239 3202 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:48.427306 3202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:48.427452 3202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:03:48.428510 3202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/data/instance:
uuid: "1d0f429b73e34846bd8e639a9d6938d3"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "914e7ce664c853612d91d7fc5e9e1380"
server_key_iv: "b3ac601e504bb34b99283d3d8e6576bc"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.428876 3202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/wal/instance:
uuid: "1d0f429b73e34846bd8e639a9d6938d3"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "914e7ce664c853612d91d7fc5e9e1380"
server_key_iv: "b3ac601e504bb34b99283d3d8e6576bc"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.430167 3202 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:03:48.430919 3225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:48.431092 3202 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:03:48.431198 3202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/wal
uuid: "1d0f429b73e34846bd8e639a9d6938d3"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "914e7ce664c853612d91d7fc5e9e1380"
server_key_iv: "b3ac601e504bb34b99283d3d8e6576bc"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.431269 3202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:48.435639 3194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } attempt: 2
I20260808 21:03:48.435990 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.435870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56614)
0808 21:03:48.435927 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.435962 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 21:03:48.436357 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.436277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56626)
0808 21:03:48.436317 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.436341 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 21:03:48.436453 3194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:45653: Network error: Client connection negotiation failed: client connection to 127.14.146.253:45653: connect: Connection refused (error 111)
I20260808 21:03:48.458083 3202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:48.460445 3202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:48.460609 3202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:48.464639 3202 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.253:45653
I20260808 21:03:48.464695 3300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.253:45653 every 8 connection(s)
I20260808 21:03:48.465041 3202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
I20260808 21:03:48.465939 3302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:48.467470 3302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:48.474575 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 3202
I20260808 21:03:48.474691 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-1/wal/instance
I20260808 21:03:48.474880 14923 external_mini_cluster.cc:1428] Setting key bb6456cc4ee2794b07bbfdd674b439aa
I20260808 21:03:48.476055 3199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.468180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35846 (local address 127.14.146.254:45343)
0808 21:03:48.468255 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.468271 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.468465 (+ 194us) server_negotiation.cc:407] Connection header received
0808 21:03:48.468957 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.468958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.468972 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.469036 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.469641 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.470145 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.471131 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.471367 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.471447 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.473421 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.473422 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.473422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.473431 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.474616 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.475058 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.475060 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.475060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.475124 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.475395 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.475396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.475396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.475517 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.475596 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.475873 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.475965 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 21:03:48.476238 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.468164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45343 (local address 127.0.0.1:35846)
0808 21:03:48.468342 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.468376 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.468845 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.469111 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.469115 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.469353 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.469539 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.469543 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.470247 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.470249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.471032 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.471034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.471456 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.471458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.471593 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.471986 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.471993 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.473323 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.474713 (+ 1390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.474721 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.474724 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.474993 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.475193 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.475194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.475195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.475322 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.475588 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.475595 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.475735 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.475839 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.475988 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":82,"threads_started":1}
I20260808 21:03:48.477109 3302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.146.252@KRBTEST.COM; defaulting to no policy
I20260808 21:03:48.484043 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.477350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56628)
0808 21:03:48.477402 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.477412 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.477455 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.477728 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.477729 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.477864 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.477905 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.477907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.478743 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.478744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.479230 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.479232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.479691 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.479692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.479763 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.480186 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.480191 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.481280 (+ 1089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.482968 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.482969 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.482969 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.483138 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.483370 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.483370 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.483371 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.483431 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.483735 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.483736 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.483774 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.483840 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.483936 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 21:03:48.484171 3307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.477418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56628 (local address 127.14.146.253:45653)
0808 21:03:48.477574 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.477578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.477605 (+ 27us) server_negotiation.cc:407] Connection header received
0808 21:03:48.477622 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.477623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.477633 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.477711 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.477981 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.478636 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.479326 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.479613 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.479694 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.481365 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.481374 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.481374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.481380 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.482866 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.483231 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.483234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.483234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.483291 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.483501 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.483502 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.483502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.483649 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.483739 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.483875 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.484004 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260808 21:03:48.484836 3302 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:03:48.485154 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.485033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58040)
0808 21:03:48.485079 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.485138 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 21:03:48.485277 3227 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
I20260808 21:03:48.485726 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.485626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58046)
0808 21:03:48.485685 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.485710 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 21:03:48.485818 3302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:46197: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab.
Entry for principal kudu/127.14.146.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab.
I20260808 21:03:48.502625 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.252:46197
--webserver_interface=127.14.146.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab
--principal=kudu/127.14.146.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:35181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45343,127.14.146.253:45653,127.14.146.252:46197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:03:48.527606 3194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } attempt: 3
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
I20260808 21:03:48.535039 3302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } attempt: 1
I20260808 21:03:48.535490 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.535358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58050)
0808 21:03:48.535426 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.535453 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 21:03:48.535632 3307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.528100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56632 (local address 127.14.146.253:45653)
0808 21:03:48.528177 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.528179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.528191 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:03:48.528272 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.528274 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.528286 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.528350 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.528662 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.529440 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.530117 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.530439 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.530512 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.532629 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.532631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.532631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.532638 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.534249 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.534697 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.534698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.534698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.534763 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.535001 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.535001 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.535002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.535151 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.535236 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.535458 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.535540 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 21:03:48.535636 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.528020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56632)
0808 21:03:48.528125 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.528146 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.528200 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.528364 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.528365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.528514 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.528585 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.528587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.529516 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.529517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.530028 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.530030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.530514 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.530515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.530573 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.531049 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.531054 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.532539 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.534343 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.534344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.534344 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.534573 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.534836 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.534837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.534838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.534913 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.535268 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.535270 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.535327 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.535432 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.535540 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 21:03:48.535998 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.535915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58060)
0808 21:03:48.535946 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.535977 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 21:03:48.536177 3302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:46197: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
I20260808 21:03:48.536157 3194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:03:48.536500 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.536401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58072)
0808 21:03:48.536437 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.536471 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 21:03:48.536825 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.536723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58086)
0808 21:03:48.536778 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.536806 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 21:03:48.536935 3194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:46197: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
I20260808 21:03:48.568224 3194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } attempt: 1
I20260808 21:03:48.568843 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.568688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58100)
0808 21:03:48.568766 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.568813 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 21:03:48.569239 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.569140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58114)
0808 21:03:48.569189 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.569223 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 21:03:48.569370 3194 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:46197: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
W20260808 21:03:48.588582 3312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:48.588788 3312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:48.588809 3312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:48.589874 3312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:48.589908 3312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:48.589923 3312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:48.589936 3312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:48.589947 3312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:48.591365 3312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45343,127.14.146.253:45653,127.14.146.252:46197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab
--principal=kudu/127.14.146.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.252:46197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.146.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:48.591557 3312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:48.591722 3312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:48.596763 3320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:48.596763 3323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:48.596783 3319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:48.596837 3312 server_base.cc:1034] running on GCE node
I20260808 21:03:48.597225 3312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:48.597568 3312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:48.598726 3312 hybrid_clock.cc:648] HybridClock initialized: now 1786223028598713 us; error 33 us; skew 500 ppm
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:48.601473 3312 init.cc:377] Logged in from keytab as kudu/127.14.146.252@KRBTEST.COM (short username kudu)
I20260808 21:03:48.601965 3312 webserver.cc:460] Webserver started at http://127.14.146.252:35583/ using document root <none> and password file <none>
I20260808 21:03:48.602192 3312 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:48.602237 3312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:48.602385 3312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:03:48.603468 3312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/data/instance:
uuid: "d0431fb505b34efb8d980d050d1a336b"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "5876a192389095ecefc4ae9480881e47"
server_key_iv: "4681d1b4e19f5bdbb0157bd08e54e491"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.603849 3312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/wal/instance:
uuid: "d0431fb505b34efb8d980d050d1a336b"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "5876a192389095ecefc4ae9480881e47"
server_key_iv: "4681d1b4e19f5bdbb0157bd08e54e491"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.604312 3302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } attempt: 2
I20260808 21:03:48.604696 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.604571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58124)
0808 21:03:48.604633 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.604669 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 21:03:48.605038 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.604944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58126)
0808 21:03:48.604988 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.605013 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 21:03:48.605131 3302 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:46197: Network error: Client connection negotiation failed: client connection to 127.14.146.252:46197: connect: Connection refused (error 111)
I20260808 21:03:48.605455 3312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:03:48.606204 3332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:48.606389 3312 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:03:48.606500 3312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/wal
uuid: "d0431fb505b34efb8d980d050d1a336b"
format_stamp: "Formatted at 2026-08-08 21:03:48 on dist-test-slave-t3q3"
server_key: "5876a192389095ecefc4ae9480881e47"
server_key_iv: "4681d1b4e19f5bdbb0157bd08e54e491"
server_key_version: "encryptionkey@0"
I20260808 21:03:48.606573 3312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:48.617624 3312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:48.619671 3312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:48.619832 3312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:48.624006 3312 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.252:46197
I20260808 21:03:48.624054 3408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.252:46197 every 8 connection(s)
I20260808 21:03:48.624472 3312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
I20260808 21:03:48.625378 3410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:48.626986 3410 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:03:48.627848 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 3312
I20260808 21:03:48.627948 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786222870463854-14923-0/minicluster-data/master-2/wal/instance
I20260808 21:03:48.628188 14923 external_mini_cluster.cc:1428] Setting key 725c8bb812babfc6c5ee84beaaa2346d
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
I20260808 21:03:48.637106 3199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.627741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35848 (local address 127.14.146.254:45343)
0808 21:03:48.627805 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.627811 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.628109 (+ 298us) server_negotiation.cc:407] Connection header received
0808 21:03:48.628825 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.628826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.628840 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.628891 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.629483 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.629969 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.630974 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.631180 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.631266 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.633773 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.633775 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.633775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.633783 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.635592 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.636088 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.636089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.636090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.636151 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.636435 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.636436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.636437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.636558 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.636631 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.636926 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.637015 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 21:03:48.637308 3417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.628603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58134 (local address 127.14.146.252:46197)
0808 21:03:48.628774 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.628778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.628856 (+ 78us) server_negotiation.cc:407] Connection header received
0808 21:03:48.628947 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.628950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.628970 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.629069 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.629689 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.630494 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.631298 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.631612 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.631704 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.634387 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.634396 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.634396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.634403 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.635949 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.636361 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.636364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.636365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.636427 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.636641 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.636642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.636642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.636796 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.636967 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.637038 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.637125 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260808 21:03:48.637307 3413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.627719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45343 (local address 127.0.0.1:35848)
0808 21:03:48.627923 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.627971 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.628705 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.628951 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.628955 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.629219 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.629375 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.629379 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.630056 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.630057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.630876 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.630879 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.631273 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.631274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.631413 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.631961 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.631972 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.633675 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.635697 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.635706 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.635708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.635986 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.636246 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.636247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.636247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.636356 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.636638 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.636646 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.636779 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.636876 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.637028 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":80,"thread_start_us":93,"threads_started":1}
I20260808 21:03:48.638032 3410 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:48.644513 3194 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } attempt: 2
I20260808 21:03:48.645041 3307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.638385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56634 (local address 127.14.146.253:45653)
0808 21:03:48.638429 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.638431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.638487 (+ 56us) server_negotiation.cc:407] Connection header received
0808 21:03:48.638558 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.638559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.638567 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.638623 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.638889 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.639345 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.640001 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.640267 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.640343 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.642157 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.642158 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.642159 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.642166 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.643649 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.644028 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.644029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.644029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.644146 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.644357 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.644358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.644358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.644508 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.644577 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.644827 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.644916 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:03:48.645468 3413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.638297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:45653 (local address 127.0.0.1:56634)
0808 21:03:48.638448 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.638457 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.638497 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.638627 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.638628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.638765 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.638807 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.638809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.639436 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.639437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.639907 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.639908 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.640340 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.640341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.640410 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.640899 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.640904 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.642069 (+ 1165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.643743 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.643744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.643744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.643950 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.644216 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.644217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.644218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.644288 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.644647 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.644648 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.644693 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.645279 (+ 586us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.645376 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260808 21:03:48.645835 3410 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:03:48.646014 3199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.638180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35860 (local address 127.14.146.254:45343)
0808 21:03:48.638212 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.638214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.638287 (+ 73us) server_negotiation.cc:407] Connection header received
0808 21:03:48.638333 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.638333 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.638344 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.638405 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.638821 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.639270 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.639924 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.640213 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.640286 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.642604 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.642605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.642606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.642612 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.644361 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.644740 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.644741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.644741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.644800 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.645043 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.645044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.645045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.645198 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.645390 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.645826 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.645907 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
I20260808 21:03:48.653049 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.644741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58138)
0808 21:03:48.644806 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.644818 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.644857 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.645094 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.645095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.645249 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.645286 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.645288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.646188 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.646189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.646935 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.646938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.647282 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.647283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.647344 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.647752 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.647757 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.649181 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.651646 (+ 2465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.651647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.651647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.651889 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.652289 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.652290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.652291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.652367 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.652688 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.652689 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.652740 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.652815 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.652918 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 21:03:48.653110 3417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.644935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58138 (local address 127.14.146.252:46197)
0808 21:03:48.644997 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.644998 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.645006 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:03:48.645025 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.645027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.645038 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.645089 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.645377 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.646079 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.647008 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.647192 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.647273 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.649277 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.649278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.649278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.649286 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.651556 (+ 2270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.652015 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.652016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.652017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.652188 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.652446 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.652448 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.652448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.652566 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.652655 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.652864 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.653008 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 21:03:48.655361 3413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.646061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58140)
0808 21:03:48.646236 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.646246 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.646287 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.647471 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.647471 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.647611 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.647635 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.647636 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.648473 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.648474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.649208 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.649221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.649690 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.649691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.649772 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.650152 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.650158 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.652252 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.654271 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.654271 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.654272 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.654443 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.654666 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.654667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.654667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.654723 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.655013 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.655013 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.655052 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.655151 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.655250 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260808 21:03:48.655404 3194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: Bootstrap starting.
I20260808 21:03:48.655930 3307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.646678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56638 (local address 127.14.146.253:45653)
0808 21:03:48.646727 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.646729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.646737 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:03:48.646757 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.646758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.646767 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.646824 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.647254 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.647944 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.648790 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.649025 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.649104 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.652437 (+ 3333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.652438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.652438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.652446 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.654487 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.654888 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.654889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.654890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.654950 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.655192 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.655193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.655193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.655324 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.655485 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.655724 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.655808 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:03:48.655463 3418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.646091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58140 (local address 127.14.146.252:46197)
0808 21:03:48.647350 (+ 1259us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.647352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.647357 (+ 5us) server_negotiation.cc:407] Connection header received
0808 21:03:48.647373 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.647374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.647382 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.647441 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.647698 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.648388 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.649287 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.649613 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.649683 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.652342 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.652343 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.652344 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.652350 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.654166 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.654529 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.654530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.654530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.654583 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.654804 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.654805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.654805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.654935 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.655008 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.655178 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.655301 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":1239,"thread_start_us":107,"threads_started":1}
I20260808 21:03:48.656318 3194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:48.656695 3194 log.cc:824] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:48.657562 3194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: No bootstrap required, opened a new log
I20260808 21:03:48.657789 3410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b: Bootstrap starting.
I20260808 21:03:48.657930 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:03:48.658424 3410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:48.658715 3410 log.cc:824] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:48.659518 3410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b: No bootstrap required, opened a new log
I20260808 21:03:48.659705 3194 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.659862 3194 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:48.659909 3194 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2570657cccb4c7e9533955a04f99ec8, State: Initialized, Role: FOLLOWER
I20260808 21:03:48.660094 3194 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.660456 3194 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:03:48.661710 3410 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.661875 3410 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:48.661924 3410 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0431fb505b34efb8d980d050d1a336b, State: Initialized, Role: FOLLOWER
I20260808 21:03:48.662053 3410 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.662357 3410 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [sys.catalog]: configured and running, proceeding with master startup.
W20260808 21:03:48.665709 3467 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:03:48.665822 3467 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:03:48.663081 3099 master_runner.cc:186] Error getting master registration for 127.14.146.253:45653: OK, instance_id { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" instance_seqno: 1786223028463386 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 21:03:48.665948 3099 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 21:03:48.667129 3450 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.667248 3450 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [sys.catalog]: This master's current role is: FOLLOWER
W20260808 21:03:48.668164 3448 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:03:48.668220 3448 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:03:48.668540 3199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.659732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35874 (local address 127.14.146.254:45343)
0808 21:03:48.659897 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.659899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.660022 (+ 123us) server_negotiation.cc:407] Connection header received
0808 21:03:48.660161 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.660162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.660173 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.660205 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.660980 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.661757 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.662996 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.663310 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.663363 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.664949 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.664951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.664951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.664959 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.666700 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.667537 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.667539 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.667539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.667614 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.667825 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.667826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.667826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.667954 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.668039 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.668361 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.668449 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260808 21:03:48.667374 3312 master_runner.cc:186] Error getting master registration for 127.14.146.253:45653: OK, instance_id { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" instance_seqno: 1786223028463386 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 21:03:48.670015 3312 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 21:03:48.671765 3418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.659856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58148 (local address 127.14.146.252:46197)
0808 21:03:48.660032 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.660033 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.662093 (+ 2060us) server_negotiation.cc:407] Connection header received
0808 21:03:48.662210 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.662211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.662222 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.662252 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.663011 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.663727 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.665621 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.665924 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.665972 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.668787 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.668789 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.668789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.668797 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.670574 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.670932 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.670933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.670933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.670995 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.671217 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.671218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.671218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.671349 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.671478 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.671566 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.671659 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260808 21:03:48.672073 3434 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.672187 3434 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:03:48.672649 3307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.659812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56642 (local address 127.14.146.253:45653)
0808 21:03:48.659856 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.659857 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.659864 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:03:48.659891 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.659892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.659901 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.659954 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.661043 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.661750 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.666347 (+ 4597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.666620 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.666664 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.669072 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.669073 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.669074 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.669081 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.671322 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.671795 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.671797 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.671797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.671864 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.672111 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.672112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.672112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.672262 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.672345 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.672497 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.672571 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:03:48.696274 3302 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } attempt: 3
Aug 08 21:03:48 dist-test-slave-t3q3 krb5kdc[3079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223028, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
I20260808 21:03:48.704728 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.696584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:46197 (local address 127.0.0.1:58164)
0808 21:03:48.696638 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:48.696650 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:48.696687 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:48.696846 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:48.696848 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:48.697052 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:48.697120 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.697122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.698080 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.698082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.698874 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:48.698877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.699364 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.699366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:48.699430 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.699971 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:48.699977 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:48.701602 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:48.703497 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.703498 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.703499 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.703737 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.703959 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:48.703960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:48.703961 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:48.704032 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:48.704378 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:48.704379 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:48.704431 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 21:03:48.704506 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 21:03:48.704608 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 21:03:48.704772 3418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:48.696648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58164 (local address 127.14.146.252:46197)
0808 21:03:48.696691 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:48.696693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:48.696737 (+ 44us) server_negotiation.cc:407] Connection header received
0808 21:03:48.696761 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:48.696762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:48.696773 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:48.696824 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:48.697204 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.697984 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.698969 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:48.699280 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:48.699354 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:48.701698 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:48.701700 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:48.701700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:48.701708 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:48.703400 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.703818 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.703819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.703820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.703883 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:48.704140 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:48.704141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:48.704141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:48.704299 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:48.704374 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:48.704548 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 21:03:48.704638 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:03:48.706903 3302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3: Bootstrap starting.
I20260808 21:03:48.707697 3302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:48.708022 3302 log.cc:824] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:48.709139 3302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3: No bootstrap required, opened a new log
I20260808 21:03:48.711198 3302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.711344 3302 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:48.711380 3302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d0f429b73e34846bd8e639a9d6938d3, State: Initialized, Role: FOLLOWER
I20260808 21:03:48.711505 3302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.711846 3302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:03:48.711808 3473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.712004 3473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 21:03:48.713773 3492 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:03:48.713982 3492 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:03:48.715754 3202 master_runner.cc:263] No leader master found from master 1d0f429b73e34846bd8e639a9d6938d3
I20260808 21:03:48.715804 3202 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 21:03:48.772377 3473 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:03:48.772523 3473 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.772806 3473 leader_election.cc:288] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2570657cccb4c7e9533955a04f99ec8 (127.14.146.254:45343), d0431fb505b34efb8d980d050d1a336b (127.14.146.252:46197)
I20260808 21:03:48.773336 3369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d0f429b73e34846bd8e639a9d6938d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0431fb505b34efb8d980d050d1a336b" is_pre_election: true
I20260808 21:03:48.773509 3369 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d0f429b73e34846bd8e639a9d6938d3 in term 0.
I20260808 21:03:48.773926 3227 leader_election.cc:302] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d0f429b73e34846bd8e639a9d6938d3, d0431fb505b34efb8d980d050d1a336b; no voters:
I20260808 21:03:48.774272 3152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d0f429b73e34846bd8e639a9d6938d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2570657cccb4c7e9533955a04f99ec8" is_pre_election: true
I20260808 21:03:48.774417 3152 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d0f429b73e34846bd8e639a9d6938d3 in term 0.
I20260808 21:03:48.774605 3473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:03:48.774670 3473 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:03:48.774694 3473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:48.775650 3473 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.775791 3473 leader_election.cc:288] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [CANDIDATE]: Term 1 election: Requested vote from peers f2570657cccb4c7e9533955a04f99ec8 (127.14.146.254:45343), d0431fb505b34efb8d980d050d1a336b (127.14.146.252:46197)
I20260808 21:03:48.776145 3369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d0f429b73e34846bd8e639a9d6938d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0431fb505b34efb8d980d050d1a336b"
I20260808 21:03:48.776226 3369 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:48.777105 3369 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d0f429b73e34846bd8e639a9d6938d3 in term 1.
I20260808 21:03:48.777343 3227 leader_election.cc:302] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d0f429b73e34846bd8e639a9d6938d3, d0431fb505b34efb8d980d050d1a336b; no voters:
I20260808 21:03:48.777697 3152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1d0f429b73e34846bd8e639a9d6938d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2570657cccb4c7e9533955a04f99ec8"
I20260808 21:03:48.777807 3152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:48.778752 3152 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d0f429b73e34846bd8e639a9d6938d3 in term 1.
I20260808 21:03:48.779958 3473 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:03:48.780174 3473 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [term 1 LEADER]: Becoming Leader. State: Replica: 1d0f429b73e34846bd8e639a9d6938d3, State: Running, Role: LEADER
I20260808 21:03:48.780283 3473 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } }
I20260808 21:03:48.780664 3473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d0f429b73e34846bd8e639a9d6938d3. Latest consensus state: current_term: 1 leader_uuid: "1d0f429b73e34846bd8e639a9d6938d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.780757 3473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:48.781087 3502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:03:48.781330 3502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:03:48.783622 3369 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [term 1 FOLLOWER]: Refusing update from remote peer 1d0f429b73e34846bd8e639a9d6938d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:03:48.783916 3152 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [term 1 FOLLOWER]: Refusing update from remote peer 1d0f429b73e34846bd8e639a9d6938d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:03:48.784446 3473 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:03:48.784590 3473 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:03:48.786010 3450 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d0f429b73e34846bd8e639a9d6938d3. Latest consensus state: current_term: 1 leader_uuid: "1d0f429b73e34846bd8e639a9d6938d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.786019 3434 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d0f429b73e34846bd8e639a9d6938d3. Latest consensus state: current_term: 1 leader_uuid: "1d0f429b73e34846bd8e639a9d6938d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.786119 3450 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:03:48.786139 3434 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:03:48.787524 3450 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d0f429b73e34846bd8e639a9d6938d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.787609 3450 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:03:48.788033 3473 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d0f429b73e34846bd8e639a9d6938d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.788127 3473 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:48.788267 3503 mvcc.cc:205] Tried to move back new op lower bound from 7316369525894696960 to 7316369525884571648. Current Snapshot: MvccSnapshot[applied={T|T < 7316369525894696960}]
I20260808 21:03:48.788806 3504 mvcc.cc:205] Tried to move back new op lower bound from 7316369525894696960 to 7316369525884571648. Current Snapshot: MvccSnapshot[applied={T|T < 7316369525894696960}]
I20260808 21:03:48.789391 3502 catalog_manager.cc:1347] Generated new cluster ID: 297a9c5d98aa4c9bbc72dfc346368b99
I20260808 21:03:48.789439 3502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
W20260808 21:03:48.790781 3127 tablet.cc:2369] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:03:48.797052 3434 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1d0f429b73e34846bd8e639a9d6938d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.797061 3495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1d0f429b73e34846bd8e639a9d6938d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2570657cccb4c7e9533955a04f99ec8" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45343 } } peers { permanent_uuid: "1d0f429b73e34846bd8e639a9d6938d3" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 45653 } } peers { permanent_uuid: "d0431fb505b34efb8d980d050d1a336b" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 46197 } } }
I20260808 21:03:48.797142 3434 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:03:48.797147 3495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:48.798405 3506 mvcc.cc:205] Tried to move back new op lower bound from 7316369525894696960 to 7316369525884571648. Current Snapshot: MvccSnapshot[applied={T|T < 7316369525894696960}]
I20260808 21:03:48.798668 3502 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:03:48.799408 3502 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:03:48.813686 3502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d0f429b73e34846bd8e639a9d6938d3: Generated new TSK 0
I20260808 21:03:48.813966 3502 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:03:49.666352 3467 catalog_manager.cc:1259] Loaded cluster ID: 297a9c5d98aa4c9bbc72dfc346368b99
I20260808 21:03:49.666438 3467 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b: loading cluster ID for follower catalog manager: success
I20260808 21:03:49.667296 3467 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b: acquiring CA information for follower catalog manager: success
I20260808 21:03:49.667629 3467 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d0431fb505b34efb8d980d050d1a336b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:03:49.668654 3448 catalog_manager.cc:1259] Loaded cluster ID: 297a9c5d98aa4c9bbc72dfc346368b99
I20260808 21:03:49.668718 3448 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: loading cluster ID for follower catalog manager: success
I20260808 21:03:49.669435 3448 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: acquiring CA information for follower catalog manager: success
I20260808 21:03:49.669672 3448 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f2570657cccb4c7e9533955a04f99ec8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:03:49.878674 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 3099
I20260808 21:03:49.887504 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 3202
I20260808 21:03:49.901564 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 3312
2026-08-08T21:03:49Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3135 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:03:49 dist-test-slave-t3q3 krb5kdc[3528](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:03:49 dist-test-slave-t3q3 krb5kdc[3528](info): set up 2 sockets
Aug 08 21:03:49 dist-test-slave-t3q3 krb5kdc[3528](info): commencing operation
krb5kdc: starting...
W20260808 21:03:51.154141 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:03:51 dist-test-slave-t3q3 krb5kdc[3528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:03:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:03:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:03:51.276333 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:33607
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:38739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:33607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:51.358632 3549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:51.358843 3549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:51.358865 3549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:51.359928 3549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:51.359962 3549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:51.359977 3549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:51.359989 3549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:51.360001 3549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:51.361486 3549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:38739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:33607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:33607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:51.361685 3549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:51.361860 3549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 21:03:51.366863 3549 server_base.cc:1034] running on GCE node
W20260808 21:03:51.366835 3559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:51.366820 3560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:51.366822 3563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:51.367344 3549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:51.367651 3549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:51.368816 3549 hybrid_clock.cc:648] HybridClock initialized: now 1786223031368791 us; error 38 us; skew 500 ppm
Aug 08 21:03:51 dist-test-slave-t3q3 krb5kdc[3528](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223031, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:51.371393 3549 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:03:51.371852 3549 webserver.cc:460] Webserver started at http://127.14.146.254:41787/ using document root <none> and password file <none>
I20260808 21:03:51.372033 3549 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:51.372128 3549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:51.372241 3549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:03:51.373260 3549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "c093e9a1039443bb846d42d272accd8c"
format_stamp: "Formatted at 2026-08-08 21:03:51 on dist-test-slave-t3q3"
server_key: "d944ed7696f0806ce43b1530637c350a"
server_key_iv: "8dcf4269eff4f57611936b13e8096ea6"
server_key_version: "encryptionkey@0"
I20260808 21:03:51.373566 3549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "c093e9a1039443bb846d42d272accd8c"
format_stamp: "Formatted at 2026-08-08 21:03:51 on dist-test-slave-t3q3"
server_key: "d944ed7696f0806ce43b1530637c350a"
server_key_iv: "8dcf4269eff4f57611936b13e8096ea6"
server_key_version: "encryptionkey@0"
I20260808 21:03:51.374915 3549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:03:51.375638 3572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:51.375823 3549 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:03:51.375917 3549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "c093e9a1039443bb846d42d272accd8c"
format_stamp: "Formatted at 2026-08-08 21:03:51 on dist-test-slave-t3q3"
server_key: "d944ed7696f0806ce43b1530637c350a"
server_key_iv: "8dcf4269eff4f57611936b13e8096ea6"
server_key_version: "encryptionkey@0"
I20260808 21:03:51.375975 3549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:51.397476 3549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:51.399899 3549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:51.400027 3549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:51.404188 3549 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:33607
I20260808 21:03:51.404297 3653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:33607 every 8 connection(s)
I20260808 21:03:51.404618 3549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:03:51.405514 3654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:51.407797 3654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c: Bootstrap starting.
I20260808 21:03:51.408361 3654 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:51.408599 3654 log.cc:824] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:51.409296 3654 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c: No bootstrap required, opened a new log
I20260808 21:03:51.410902 3654 raft_consensus.cc:348] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c093e9a1039443bb846d42d272accd8c" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33607 } }
I20260808 21:03:51.410993 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 3549
I20260808 21:03:51.411036 3654 raft_consensus.cc:374] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:51.411059 3654 raft_consensus.cc:729] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c093e9a1039443bb846d42d272accd8c, State: Initialized, Role: FOLLOWER
I20260808 21:03:51.411131 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:03:51.411259 3654 consensus_queue.cc:260] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c093e9a1039443bb846d42d272accd8c" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33607 } }
I20260808 21:03:51.411337 3654 raft_consensus.cc:388] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:03:51.411350 14923 external_mini_cluster.cc:1428] Setting key f36ec75cbcdaaa46ce113f1a49561f20
I20260808 21:03:51.411360 3654 raft_consensus.cc:482] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:03:51.411437 3654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:51.412564 3654 raft_consensus.cc:504] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c093e9a1039443bb846d42d272accd8c" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33607 } }
I20260808 21:03:51.412688 3654 leader_election.cc:302] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c093e9a1039443bb846d42d272accd8c; no voters:
I20260808 21:03:51.412885 3654 leader_election.cc:288] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:03:51.412922 3661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:03:51.413093 3661 raft_consensus.cc:686] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [term 1 LEADER]: Becoming Leader. State: Replica: c093e9a1039443bb846d42d272accd8c, State: Running, Role: LEADER
I20260808 21:03:51.413170 3654 sys_catalog.cc:564] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:03:51.413228 3661 consensus_queue.cc:237] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c093e9a1039443bb846d42d272accd8c" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33607 } }
I20260808 21:03:51.413630 3661 sys_catalog.cc:455] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c093e9a1039443bb846d42d272accd8c. Latest consensus state: current_term: 1 leader_uuid: "c093e9a1039443bb846d42d272accd8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c093e9a1039443bb846d42d272accd8c" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33607 } } }
I20260808 21:03:51.413707 3661 sys_catalog.cc:458] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:51.413992 3664 sys_catalog.cc:455] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c093e9a1039443bb846d42d272accd8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c093e9a1039443bb846d42d272accd8c" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33607 } } }
I20260808 21:03:51.414095 3664 sys_catalog.cc:458] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c [sys.catalog]: This master's current role is: LEADER
W20260808 21:03:51.415704 3690 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:03:51.415807 3690 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:03:51.415903 3675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:03:51.416095 3675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:03:51.417779 3675 catalog_manager.cc:1347] Generated new cluster ID: 16f00fadfc7a43118ce04580930a2c3e
I20260808 21:03:51.417835 3675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:03:51 dist-test-slave-t3q3 krb5kdc[3528](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:51.422966 3660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:51.411844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53594 (local address 127.14.146.254:33607)
0808 21:03:51.412046 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:51.412094 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:51.412134 (+ 40us) server_negotiation.cc:407] Connection header received
0808 21:03:51.412240 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:51.412245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:51.412296 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:51.412402 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:51.413316 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:51.414879 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:51.415827 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:51.416402 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:51.416543 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:51.419109 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:51.419113 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:51.419113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:51.419133 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:51.420909 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:51.421308 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:51.421311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:51.421311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:51.421885 (+ 574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:51.422120 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:51.422121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:51.422122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:51.422373 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:51.422552 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:51.422654 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 21:03:51.422801 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":149,"thread_start_us":118,"threads_started":1}
I20260808 21:03:51.423902 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:03:51.438593 3675 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:03:51.439184 3675 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:03:51.444268 3675 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c093e9a1039443bb846d42d272accd8c: Generated new TSK 0
I20260808 21:03:51.444473 3675 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:03:51.478030 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 3549
2026-08-08T21:03:51Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1585 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:03:51 dist-test-slave-t3q3 krb5kdc[3697](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:03:51 dist-test-slave-t3q3 krb5kdc[3697](info): set up 2 sockets
Aug 08 21:03:51 dist-test-slave-t3q3 krb5kdc[3697](info): commencing operation
krb5kdc: starting...
W20260808 21:03:52.739068 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:03:52 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:03:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:03:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:03:52.869261 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39815
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:39815
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:52.958776 3719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:52.958985 3719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:52.959008 3719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:52.960208 3719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:52.960250 3719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:52.960264 3719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:52.960278 3719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:52.960326 3719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:52.961876 3719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:39815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:52.962137 3719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:52.962370 3719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:52.967434 3727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:52.967455 3729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:52.967438 3726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:52.967737 3719 server_base.cc:1034] running on GCE node
I20260808 21:03:52.967974 3719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:52.968297 3719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:52.969450 3719 hybrid_clock.cc:648] HybridClock initialized: now 1786223032969436 us; error 29 us; skew 500 ppm
Aug 08 21:03:52 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223032, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:52.972045 3719 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:03:52.972512 3719 webserver.cc:460] Webserver started at http://127.14.146.254:44147/ using document root <none> and password file <none>
I20260808 21:03:52.972733 3719 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:52.972777 3719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:52.972865 3719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:03:52.973924 3719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "013800af4d1c4276a9c4c83eaf1f47a2"
format_stamp: "Formatted at 2026-08-08 21:03:52 on dist-test-slave-t3q3"
server_key: "370d2942e98ea2bb2d836c22a189a7fd"
server_key_iv: "e30bd584bb5c560776b0d844ddcb8994"
server_key_version: "encryptionkey@0"
I20260808 21:03:52.974226 3719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "013800af4d1c4276a9c4c83eaf1f47a2"
format_stamp: "Formatted at 2026-08-08 21:03:52 on dist-test-slave-t3q3"
server_key: "370d2942e98ea2bb2d836c22a189a7fd"
server_key_iv: "e30bd584bb5c560776b0d844ddcb8994"
server_key_version: "encryptionkey@0"
I20260808 21:03:52.975534 3719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 21:03:52.976296 3740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:52.976455 3719 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:52.976554 3719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "013800af4d1c4276a9c4c83eaf1f47a2"
format_stamp: "Formatted at 2026-08-08 21:03:52 on dist-test-slave-t3q3"
server_key: "370d2942e98ea2bb2d836c22a189a7fd"
server_key_iv: "e30bd584bb5c560776b0d844ddcb8994"
server_key_version: "encryptionkey@0"
I20260808 21:03:52.976613 3719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:52.985330 3719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:52.987180 3719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:52.987301 3719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:52.991360 3719 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:39815
I20260808 21:03:52.991465 3812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:39815 every 8 connection(s)
I20260808 21:03:52.991779 3719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:03:52.992903 3813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:52.995397 3813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Bootstrap starting.
I20260808 21:03:52.995487 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 3719
I20260808 21:03:52.995592 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:03:52.995824 14923 external_mini_cluster.cc:1428] Setting key 1d270368c3a4889107a946088ba38dd7
I20260808 21:03:52.996229 3813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:52.996605 3813 log.cc:824] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:52.997400 3813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: No bootstrap required, opened a new log
I20260808 21:03:52.999279 3813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:52.999418 3813 raft_consensus.cc:374] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:52.999441 3813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013800af4d1c4276a9c4c83eaf1f47a2, State: Initialized, Role: FOLLOWER
I20260808 21:03:52.999593 3813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:52.999672 3813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:03:52.999696 3813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:03:52.999765 3813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:53.000445 3813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:53.000576 3813 leader_election.cc:302] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 013800af4d1c4276a9c4c83eaf1f47a2; no voters:
I20260808 21:03:53.000784 3813 leader_election.cc:288] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:03:53.000808 3824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:03:53.001013 3824 raft_consensus.cc:686] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 1 LEADER]: Becoming Leader. State: Replica: 013800af4d1c4276a9c4c83eaf1f47a2, State: Running, Role: LEADER
I20260808 21:03:53.001144 3813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:03:53.001152 3824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:53.001715 3826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 013800af4d1c4276a9c4c83eaf1f47a2. Latest consensus state: current_term: 1 leader_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } } }
I20260808 21:03:53.001722 3825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } } }
I20260808 21:03:53.001879 3825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:53.002100 3826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:53.002173 3834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:03:53.002811 3834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 21:03:52 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:53.004498 3834 catalog_manager.cc:1347] Generated new cluster ID: bfeb6d6a427441d79e29b7e429141130
I20260808 21:03:53.004551 3834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:03:53.007898 3821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:52.996462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33998 (local address 127.14.146.254:39815)
0808 21:03:52.996706 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:52.996716 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:52.996752 (+ 36us) server_negotiation.cc:407] Connection header received
0808 21:03:52.997368 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:52.997377 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:52.997431 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:52.997602 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:52.998254 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:52.999154 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.000203 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.000717 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.000839 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.004032 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:53.004036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:53.004036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:53.004093 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:53.006157 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.006611 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.006614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.006614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.006722 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.006946 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.006947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.006947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.007245 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:53.007405 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.007544 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.007692 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":119,"threads_started":1}
I20260808 21:03:53.015821 3834 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:03:53.016443 3834 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:03:53.030851 3834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Generated new TSK 0
I20260808 21:03:53.031091 3834 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:03:53.062987 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39815
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:53.148087 3852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:53.148346 3852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:53.148391 3852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:53.149508 3852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:53.149544 3852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:53.149571 3852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:03:53.150964 3852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:53.151156 3852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:53.151352 3852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:53.156387 3865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:53.156417 3861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:53.156414 3862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:53.156757 3852 server_base.cc:1034] running on GCE node
I20260808 21:03:53.156977 3852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:53.157277 3852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:53.158471 3852 hybrid_clock.cc:648] HybridClock initialized: now 1786223033158454 us; error 25 us; skew 500 ppm
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:53.160990 3852 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:03:53.161469 3852 webserver.cc:460] Webserver started at http://127.14.146.193:39815/ using document root <none> and password file <none>
I20260808 21:03:53.161725 3852 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:53.161796 3852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:53.161947 3852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:03:53.163004 3852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "1a7baa0210a24dd296f44f2c11e3879b"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b3f34afd74258af2ddaa50f7b343afab"
server_key_iv: "23e2a91dfef2d2bdd6de316a97fb57f2"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.163381 3852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "1a7baa0210a24dd296f44f2c11e3879b"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b3f34afd74258af2ddaa50f7b343afab"
server_key_iv: "23e2a91dfef2d2bdd6de316a97fb57f2"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.164798 3852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:03:53.165526 3875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.165701 3852 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:03:53.165820 3852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "1a7baa0210a24dd296f44f2c11e3879b"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b3f34afd74258af2ddaa50f7b343afab"
server_key_iv: "23e2a91dfef2d2bdd6de316a97fb57f2"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.165903 3852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:53.173810 3852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:53.175565 3852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:53.175863 3852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:53.176146 3852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:53.176476 3852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:53.176535 3852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.176578 3852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:53.176626 3852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.182873 3852 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:45809
I20260808 21:03:53.182924 4051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:45809 every 8 connection(s)
I20260808 21:03:53.183249 3852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:03:53.189023 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 3852
I20260808 21:03:53.189113 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:03:53.189292 14923 external_mini_cluster.cc:1428] Setting key 99d960d75e0fa0d8f7807add99698581
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:53.193740 3821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.183955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:34647 (local address 127.14.146.254:39815)
0808 21:03:53.184019 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.184021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.184234 (+ 213us) server_negotiation.cc:407] Connection header received
0808 21:03:53.184723 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.184724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.184735 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.184798 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:53.185995 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.186729 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.187728 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.187926 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.187979 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.190407 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:53.190408 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:53.190409 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:53.190417 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:53.192099 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.192638 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.192639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.192639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.192702 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.193034 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.193035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.193035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.193166 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:53.193236 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.193583 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.193670 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:03:53.194047 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.183913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:34647)
0808 21:03:53.184101 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.184143 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.184629 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.184877 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.184881 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.185578 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:53.185862 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.185867 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.186815 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.186816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.187646 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.187649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.188003 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.188004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.188181 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.188663 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:53.188671 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:53.190308 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:53.192195 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.192205 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.192208 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.192552 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.192770 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.192771 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.192771 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.192921 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.193245 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:53.193251 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:53.193434 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.193561 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.193761 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260808 21:03:53.194615 4052 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39815
I20260808 21:03:53.194736 4052 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:53.194926 4052 heartbeater.cc:511] Master 127.14.146.254:39815 requested a full tablet report, sending...
I20260808 21:03:53.195595 3763 ts_manager.cc:194] Registered new tserver with Master: 1a7baa0210a24dd296f44f2c11e3879b (127.14.146.193:45809)
I20260808 21:03:53.196610 3763 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:34647
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:03:53.218536 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39815
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:53.301919 4063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:53.302250 4063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:53.302280 4063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:53.303429 4063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:53.303472 4063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:53.303499 4063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:03:53.304908 4063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:53.305094 4063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:53.305279 4063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:53.310606 4071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:53.310680 4076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:53.310694 4063 server_base.cc:1034] running on GCE node
W20260808 21:03:53.310606 4072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:53.311071 4063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:53.311291 4063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:53.312433 4063 hybrid_clock.cc:648] HybridClock initialized: now 1786223033312418 us; error 32 us; skew 500 ppm
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:53.317691 4063 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:03:53.318171 4063 webserver.cc:460] Webserver started at http://127.14.146.194:41721/ using document root <none> and password file <none>
I20260808 21:03:53.318365 4063 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:53.318406 4063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:53.318499 4063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:03:53.319499 4063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "db583c4df6f1494e8d381fe66d5801b2"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b97903ea91b68847fdbad11ea5d72e41"
server_key_iv: "24331549f69f3a57f6a6ace385fe6ce7"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.319808 4063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "db583c4df6f1494e8d381fe66d5801b2"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b97903ea91b68847fdbad11ea5d72e41"
server_key_iv: "24331549f69f3a57f6a6ace385fe6ce7"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.321185 4063 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:03:53.321900 4086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.322093 4063 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:03:53.322190 4063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "db583c4df6f1494e8d381fe66d5801b2"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b97903ea91b68847fdbad11ea5d72e41"
server_key_iv: "24331549f69f3a57f6a6ace385fe6ce7"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.322276 4063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:53.334092 4063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:53.335920 4063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:53.336118 4063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:53.336354 4063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:53.336681 4063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:53.336738 4063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.336783 4063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:53.336810 4063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.342804 4063 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:34799
I20260808 21:03:53.342850 4260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:34799 every 8 connection(s)
I20260808 21:03:53.343204 4063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:03:53.344312 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 4063
I20260808 21:03:53.344427 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:03:53.344615 14923 external_mini_cluster.cc:1428] Setting key 935329c0bb9ca26dd790fb348ffd046b
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:53.353727 3821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.343968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:36163 (local address 127.14.146.254:39815)
0808 21:03:53.344042 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.344043 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.344254 (+ 211us) server_negotiation.cc:407] Connection header received
0808 21:03:53.344859 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.344861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.344873 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.344931 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:53.345860 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.346367 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.347670 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.347871 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.347931 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.350512 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:53.350513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:53.350524 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:53.350531 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:53.352280 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.352668 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.352669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.352670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.352734 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.353032 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.353033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.353033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.353187 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:53.353261 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.353511 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.353604 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:03:53.353746 4266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.343917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:36163)
0808 21:03:53.344116 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.344157 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.344735 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.345000 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.345004 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.345577 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:53.345760 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.345764 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.346464 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.346465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.347576 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.347579 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.347960 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.347961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.348153 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.348625 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:53.348634 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:53.350413 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:53.352361 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.352367 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.352369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.352588 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.352817 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.352818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.352819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.352948 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.353257 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:53.353263 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:53.353374 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.353459 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.353580 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":90,"threads_started":1}
I20260808 21:03:53.354267 4261 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39815
I20260808 21:03:53.354379 4261 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:53.354552 4261 heartbeater.cc:511] Master 127.14.146.254:39815 requested a full tablet report, sending...
I20260808 21:03:53.354995 3763 ts_manager.cc:194] Registered new tserver with Master: db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799)
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
I20260808 21:03:53.355501 3763 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:36163
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:03:53.374447 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39815
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:53.456841 4270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:53.457084 4270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:53.457123 4270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:53.458251 4270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:53.458323 4270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:53.458369 4270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:03:53.459825 4270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:53.460108 4270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:53.460348 4270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:53.465332 4280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:53.465394 4277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:53.465332 4276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:53.465509 4270 server_base.cc:1034] running on GCE node
I20260808 21:03:53.465718 4270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:53.465987 4270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:53.467159 4270 hybrid_clock.cc:648] HybridClock initialized: now 1786223033467140 us; error 30 us; skew 500 ppm
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:53.469985 4270 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:03:53.470441 4270 webserver.cc:460] Webserver started at http://127.14.146.195:39085/ using document root <none> and password file <none>
I20260808 21:03:53.470647 4270 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:53.470688 4270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:53.470777 4270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:03:53.471736 4270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "792da70b7d6d411ca48defbe6be933e3"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "a32a46dc3b90200f623863cb1a548c79"
server_key_iv: "c3ec7efa44c35be7ca2e926d93ed1520"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.472044 4270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "792da70b7d6d411ca48defbe6be933e3"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "a32a46dc3b90200f623863cb1a548c79"
server_key_iv: "c3ec7efa44c35be7ca2e926d93ed1520"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.473408 4270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:53.474112 4291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.474295 4270 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:03:53.474376 4270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "792da70b7d6d411ca48defbe6be933e3"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "a32a46dc3b90200f623863cb1a548c79"
server_key_iv: "c3ec7efa44c35be7ca2e926d93ed1520"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.474431 4270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:53.492425 4270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:53.494220 4270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:53.494329 4270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:53.494516 4270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:53.494839 4270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:53.494874 4270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.494896 4270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:53.494942 4270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.500779 4270 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:36473
I20260808 21:03:53.500862 4463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:36473 every 8 connection(s)
I20260808 21:03:53.501174 4270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:53.509660 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 4270
I20260808 21:03:53.509763 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:03:53.509975 14923 external_mini_cluster.cc:1428] Setting key 89006cf611ba0a25481249e1307ea653
I20260808 21:03:53.510740 3821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.501954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:42957 (local address 127.14.146.254:39815)
0808 21:03:53.501993 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.501995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.502283 (+ 288us) server_negotiation.cc:407] Connection header received
0808 21:03:53.502885 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.502886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.502897 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.502950 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:53.503875 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.504442 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.505436 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.505672 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.505734 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.507823 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:53.507825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:53.507825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:53.507834 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:53.509222 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.509606 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.509607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.509608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.509677 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.509990 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.509991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.509991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.510143 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:53.510232 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.510529 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.510634 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:03:53.510864 4468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.501957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:42957)
0808 21:03:53.502116 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.502173 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.502793 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.503003 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.503006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.503594 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:53.503789 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.503793 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.504523 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.504524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.505322 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.505324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.505751 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.505752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.505851 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.506372 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:53.506380 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:53.507709 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:53.509292 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.509297 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.509299 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.509527 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.509801 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.509802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.509804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.509919 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.510226 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:53.510232 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:53.510361 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.510483 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.510653 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260808 21:03:53.511363 4464 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39815
I20260808 21:03:53.511446 4464 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:53.511652 4464 heartbeater.cc:511] Master 127.14.146.254:39815 requested a full tablet report, sending...
I20260808 21:03:53.512028 3763 ts_manager.cc:194] Registered new tserver with Master: 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
I20260808 21:03:53.512425 3763 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:42957
I20260808 21:03:53.521689 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:03:53.528792 3821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.523180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34004 (local address 127.14.146.254:39815)
0808 21:03:53.523240 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.523241 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.523337 (+ 96us) server_negotiation.cc:407] Connection header received
0808 21:03:53.523377 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.523378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.523387 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.523436 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:53.523970 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.524500 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.525290 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.525466 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.525535 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.526660 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:53.526661 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:53.526661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:53.526667 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:53.527798 (+ 1131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.528165 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.528166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.528166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.528216 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.528385 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.528386 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.528386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.528513 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:53.528586 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.528674 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.528731 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:03:53.530241 3763 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:03:53.531920 3763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:03:53.538347 4481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.534242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:34799 (local address 127.0.0.1:35394)
0808 21:03:53.534561 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.534603 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.534673 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.534929 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.534932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.534934 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:53.535003 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.535006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.536001 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.536002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.537127 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.537130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.538021 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.538022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.538102 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.538117 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.538191 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.538254 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":45,"threads_started":1}
I20260808 21:03:53.538513 4488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.534519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53180 (local address 127.14.146.195:36473)
0808 21:03:53.534723 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.534727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.534807 (+ 80us) server_negotiation.cc:407] Connection header received
0808 21:03:53.535078 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.535081 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.535098 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.535172 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:53.535384 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.536434 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.537569 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.538123 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.538202 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.538253 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.538385 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.538430 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":104,"threads_started":1}
I20260808 21:03:53.538479 4483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.534421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:36473 (local address 127.0.0.1:53180)
0808 21:03:53.534750 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.534760 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.534823 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.535255 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.535256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.535258 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:53.535293 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.535294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.536544 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.536545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.537474 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.537477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.538215 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.538216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.538287 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.538293 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.538357 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.538406 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":82,"threads_started":1}
I20260808 21:03:53.538684 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.534375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35394 (local address 127.14.146.194:34799)
0808 21:03:53.534667 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.534670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.534683 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:03:53.534816 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.534821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.534838 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.534919 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:53.535094 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.535896 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.537217 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.537930 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.538008 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.538061 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.538551 (+ 490us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.538600 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":85,"threads_started":1}
I20260808 21:03:53.538908 4484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.534378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60532 (local address 127.14.146.193:45809)
0808 21:03:53.534565 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.534569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.534835 (+ 266us) server_negotiation.cc:407] Connection header received
0808 21:03:53.534883 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.534886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.534902 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.534989 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:53.535204 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.536343 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.537630 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.538356 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.538418 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.538466 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.538799 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.538845 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":80,"threads_started":1}
I20260808 21:03:53.538735 4487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.534242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:45809 (local address 127.0.0.1:60532)
0808 21:03:53.534712 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.534721 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.534770 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.535073 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.535074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.535076 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:53.535121 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.535123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.536464 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.536465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.537521 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.537524 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.538502 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.538503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.538561 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.538564 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.538627 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.538663 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":4,"thread_start_us":79,"threads_started":1}
I20260808 21:03:53.539670 4153 tablet_service.cc:1467] Processing CreateTablet for tablet 9076c06a60bf4318994ddbb70091b852 (DEFAULT_TABLE table=test-table [id=f474667a2b114e07bc2351f5ba442049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:53.539875 3959 tablet_service.cc:1467] Processing CreateTablet for tablet 9076c06a60bf4318994ddbb70091b852 (DEFAULT_TABLE table=test-table [id=f474667a2b114e07bc2351f5ba442049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:53.539875 4362 tablet_service.cc:1467] Processing CreateTablet for tablet 9076c06a60bf4318994ddbb70091b852 (DEFAULT_TABLE table=test-table [id=f474667a2b114e07bc2351f5ba442049]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:53.540050 4153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9076c06a60bf4318994ddbb70091b852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:53.540254 4362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9076c06a60bf4318994ddbb70091b852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:53.540253 3959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9076c06a60bf4318994ddbb70091b852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:53.542659 4489 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Bootstrap starting.
I20260808 21:03:53.543329 4489 tablet_bootstrap.cc:654] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:53.543781 4492 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Bootstrap starting.
I20260808 21:03:53.544001 4489 log.cc:824] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:53.544410 4492 tablet_bootstrap.cc:654] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:53.544768 4489 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: No bootstrap required, opened a new log
I20260808 21:03:53.544823 4489 ts_tablet_manager.cc:1397] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:03:53.544968 4492 log.cc:824] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:53.545326 4491 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: Bootstrap starting.
I20260808 21:03:53.545974 4491 tablet_bootstrap.cc:654] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:53.546460 4491 log.cc:824] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:53.546567 4489 raft_consensus.cc:348] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.546751 4489 raft_consensus.cc:374] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:53.546814 4489 raft_consensus.cc:729] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db583c4df6f1494e8d381fe66d5801b2, State: Initialized, Role: FOLLOWER
I20260808 21:03:53.546947 4489 consensus_queue.cc:260] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.547003 4492 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: No bootstrap required, opened a new log
I20260808 21:03:53.547091 4492 ts_tablet_manager.cc:1397] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 21:03:53.547240 4489 ts_tablet_manager.cc:1428] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 21:03:53.547371 4261 heartbeater.cc:503] Master 127.14.146.254:39815 was elected leader, sending a full tablet report...
I20260808 21:03:53.548977 4492 raft_consensus.cc:348] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.549145 4492 raft_consensus.cc:374] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:53.549180 4492 raft_consensus.cc:729] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7baa0210a24dd296f44f2c11e3879b, State: Initialized, Role: FOLLOWER
I20260808 21:03:53.549300 4492 consensus_queue.cc:260] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.549603 4052 heartbeater.cc:503] Master 127.14.146.254:39815 was elected leader, sending a full tablet report...
I20260808 21:03:53.549589 4492 ts_tablet_manager.cc:1428] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:03:53.549999 4491 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: No bootstrap required, opened a new log
I20260808 21:03:53.550076 4491 ts_tablet_manager.cc:1397] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 21:03:53.551569 4491 raft_consensus.cc:348] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.551724 4491 raft_consensus.cc:374] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:53.551775 4491 raft_consensus.cc:729] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 792da70b7d6d411ca48defbe6be933e3, State: Initialized, Role: FOLLOWER
I20260808 21:03:53.551885 4491 consensus_queue.cc:260] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.552189 4491 ts_tablet_manager.cc:1428] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:03:53.552215 4464 heartbeater.cc:503] Master 127.14.146.254:39815 was elected leader, sending a full tablet report...
I20260808 21:03:53.582857 4500 raft_consensus.cc:482] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:03:53.583050 4500 raft_consensus.cc:504] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.583493 4500 leader_election.cc:288] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
I20260808 21:03:53.587464 4485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.583775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:42475 (local address 127.14.146.194:34799)
0808 21:03:53.583832 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.583834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.583843 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:03:53.583871 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.583874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.583889 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.583961 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:53.584183 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.584959 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.586475 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.587068 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.587152 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.587160 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.587348 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.587391 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 21:03:53.587464 4488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.583882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:47637 (local address 127.14.146.195:36473)
0808 21:03:53.583951 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.583954 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.584020 (+ 66us) server_negotiation.cc:407] Connection header received
0808 21:03:53.584137 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.584138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.584162 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.584229 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:53.584345 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.585013 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.586476 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.587068 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.587150 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.587160 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.587352 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.587391 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:03:53.587476 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.583642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:34799 (local address 127.14.146.193:42475)
0808 21:03:53.583706 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.583719 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.583765 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.583994 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.583995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.583996 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:53.584110 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.584112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.585042 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.585042 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.586368 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.586372 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.587177 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.587178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.587262 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.587264 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.587325 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.587380 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":39}
I20260808 21:03:53.587483 4502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.583791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:36473 (local address 127.14.146.193:47637)
0808 21:03:53.583967 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.583977 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.584029 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.584243 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.584244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.584246 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:53.584293 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.584295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.585087 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.585087 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.586368 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.586372 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.587177 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.587178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.587259 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.587264 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.587325 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.587380 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":63,"thread_start_us":125,"threads_started":1}
I20260808 21:03:53.587889 4187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9076c06a60bf4318994ddbb70091b852" candidate_uuid: "1a7baa0210a24dd296f44f2c11e3879b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db583c4df6f1494e8d381fe66d5801b2" is_pre_election: true
I20260808 21:03:53.587949 4394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9076c06a60bf4318994ddbb70091b852" candidate_uuid: "1a7baa0210a24dd296f44f2c11e3879b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "792da70b7d6d411ca48defbe6be933e3" is_pre_election: true
I20260808 21:03:53.588109 4187 raft_consensus.cc:2454] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7baa0210a24dd296f44f2c11e3879b in term 0.
I20260808 21:03:53.588135 4394 raft_consensus.cc:2454] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7baa0210a24dd296f44f2c11e3879b in term 0.
I20260808 21:03:53.588382 3877 leader_election.cc:302] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b, db583c4df6f1494e8d381fe66d5801b2; no voters:
I20260808 21:03:53.588529 4500 raft_consensus.cc:2781] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:03:53.588620 4500 raft_consensus.cc:482] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:03:53.588656 4500 raft_consensus.cc:3037] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:53.589416 4500 raft_consensus.cc:504] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.589569 4500 leader_election.cc:288] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 1 election: Requested vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
I20260808 21:03:53.589751 4187 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9076c06a60bf4318994ddbb70091b852" candidate_uuid: "1a7baa0210a24dd296f44f2c11e3879b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db583c4df6f1494e8d381fe66d5801b2"
I20260808 21:03:53.589767 4394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9076c06a60bf4318994ddbb70091b852" candidate_uuid: "1a7baa0210a24dd296f44f2c11e3879b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "792da70b7d6d411ca48defbe6be933e3"
I20260808 21:03:53.589829 4187 raft_consensus.cc:3037] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:53.589864 4394 raft_consensus.cc:3037] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:53.590552 4394 raft_consensus.cc:2454] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7baa0210a24dd296f44f2c11e3879b in term 1.
I20260808 21:03:53.590553 4187 raft_consensus.cc:2454] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7baa0210a24dd296f44f2c11e3879b in term 1.
I20260808 21:03:53.590757 3877 leader_election.cc:302] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b, 792da70b7d6d411ca48defbe6be933e3; no voters:
I20260808 21:03:53.590871 4500 raft_consensus.cc:2781] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:03:53.591050 4500 raft_consensus.cc:686] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 LEADER]: Becoming Leader. State: Replica: 1a7baa0210a24dd296f44f2c11e3879b, State: Running, Role: LEADER
I20260808 21:03:53.591158 4500 consensus_queue.cc:237] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.591986 3763 catalog_manager.cc:5495] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7baa0210a24dd296f44f2c11e3879b (127.14.146.193). New cstate: current_term: 1 leader_uuid: "1a7baa0210a24dd296f44f2c11e3879b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } health_report { overall_health: UNKNOWN } } }
W20260808 21:03:53.593739 4263 tablet.cc:2369] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:03:53.598891 4484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.596724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60544 (local address 127.14.146.193:45809)
0808 21:03:53.596765 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.596767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.596776 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:03:53.596858 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.596859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.596875 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.596928 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:03:53.597062 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.597503 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.598246 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.598425 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.598474 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.598611 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:03:53.598708 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:03:53.598773 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.598808 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.598824 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:03:53.600638 4187 raft_consensus.cc:1261] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 1 FOLLOWER]: Refusing update from remote peer 1a7baa0210a24dd296f44f2c11e3879b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:03:53.600639 4394 raft_consensus.cc:1261] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 1 FOLLOWER]: Refusing update from remote peer 1a7baa0210a24dd296f44f2c11e3879b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:03:53.600981 4500 consensus_queue.cc:1035] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [LEADER]: Connected to new peer: Peer: permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:03:53.601151 4503 consensus_queue.cc:1035] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [LEADER]: Connected to new peer: Peer: permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:03:53.603389 4506 mvcc.cc:205] Tried to move back new op lower bound from 7316369545625382912 to 7316369545590001664. Current Snapshot: MvccSnapshot[applied={T|T < 7316369545625382912}]
I20260808 21:03:53.604462 4508 mvcc.cc:205] Tried to move back new op lower bound from 7316369545625382912 to 7316369545590001664. Current Snapshot: MvccSnapshot[applied={T|T < 7316369545625382912 or (T in {7316369545625382912})}]
I20260808 21:03:53.604595 4510 mvcc.cc:205] Tried to move back new op lower bound from 7316369545625382912 to 7316369545590001664. Current Snapshot: MvccSnapshot[applied={T|T < 7316369545625382912 or (T in {7316369545625382912})}]
I20260808 21:03:53.605803 3760 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:03:53.605892 3760 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:03:53.606662 3760 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Sending DeleteTablet for 3 replicas of tablet 9076c06a60bf4318994ddbb70091b852
I20260808 21:03:53.607010 3959 tablet_service.cc:1514] Processing DeleteTablet for tablet 9076c06a60bf4318994ddbb70091b852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:53 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:60532
I20260808 21:03:53.607059 4362 tablet_service.cc:1514] Processing DeleteTablet for tablet 9076c06a60bf4318994ddbb70091b852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:53 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:53180
I20260808 21:03:53.607056 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 3852
I20260808 21:03:53.607615 4153 tablet_service.cc:1514] Processing DeleteTablet for tablet 9076c06a60bf4318994ddbb70091b852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:53 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:35394
I20260808 21:03:53.612715 4522 tablet_replica.cc:330] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: stopping tablet replica
I20260808 21:03:53.612839 4522 raft_consensus.cc:2229] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:03:53.612946 4522 raft_consensus.cc:2258] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:03:53.613729 4520 tablet_replica.cc:330] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: stopping tablet replica
I20260808 21:03:53.613876 4520 raft_consensus.cc:2229] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:03:53.613981 4522 ts_tablet_manager.cc:1905] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:03:53.614018 4520 raft_consensus.cc:2258] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:03:53.614465 4520 ts_tablet_manager.cc:1905] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:03:53.615999 4520 ts_tablet_manager.cc:1918] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:03:53.616102 4520 log.cc:1196] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/9076c06a60bf4318994ddbb70091b852
I20260808 21:03:53.616092 4522 ts_tablet_manager.cc:1918] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:03:53.616183 4522 log.cc:1196] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/9076c06a60bf4318994ddbb70091b852
I20260808 21:03:53.616434 4520 ts_tablet_manager.cc:1939] T 9076c06a60bf4318994ddbb70091b852 P 792da70b7d6d411ca48defbe6be933e3: Deleting consensus metadata
I20260808 21:03:53.616569 4522 ts_tablet_manager.cc:1939] T 9076c06a60bf4318994ddbb70091b852 P db583c4df6f1494e8d381fe66d5801b2: Deleting consensus metadata
I20260808 21:03:53.616937 3743 catalog_manager.cc:4841] TS 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473): tablet 9076c06a60bf4318994ddbb70091b852 (table test-table [id=f474667a2b114e07bc2351f5ba442049]) successfully deleted
I20260808 21:03:53.617074 3743 catalog_manager.cc:4841] TS db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799): tablet 9076c06a60bf4318994ddbb70091b852 (table test-table [id=f474667a2b114e07bc2351f5ba442049]) successfully deleted
W20260808 21:03:53.621480 3745 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:45809 (error 108)
I20260808 21:03:53.621731 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 4063
I20260808 21:03:53.622355 4487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.621922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:45809 (local address 127.0.0.1:60550)
0808 21:03:53.622270 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.622315 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:45809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326}
W20260808 21:03:53.628252 3745 catalog_manager.cc:4584] TS 1a7baa0210a24dd296f44f2c11e3879b (127.14.146.193:45809): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9076c06a60bf4318994ddbb70091b852: Network error: Client connection negotiation failed: client connection to 127.14.146.193:45809: connect: Connection refused (error 111)
I20260808 21:03:53.629627 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 4270
I20260808 21:03:53.646663 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 3719
I20260808 21:03:53.661221 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39815
--webserver_interface=127.14.146.254
--webserver_port=44147
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:39815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:53.744383 4524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:53.744585 4524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:53.744606 4524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:53.745693 4524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:53.745729 4524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:53.745743 4524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:53.745756 4524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:53.745769 4524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:53.747144 4524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:39815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=44147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:53.747339 4524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:53.747550 4524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:53.757350 4536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:53.757350 4533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:53.757350 4532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:53.757624 4524 server_base.cc:1034] running on GCE node
I20260808 21:03:53.757923 4524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:53.758237 4524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:53.759402 4524 hybrid_clock.cc:648] HybridClock initialized: now 1786223033759389 us; error 43 us; skew 500 ppm
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:53.762035 4524 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:03:53.762494 4524 webserver.cc:460] Webserver started at http://127.14.146.254:44147/ using document root <none> and password file <none>
I20260808 21:03:53.762688 4524 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:53.762750 4524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:53.764142 4524 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:53.764786 4545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.764981 4524 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:53.765060 4524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "013800af4d1c4276a9c4c83eaf1f47a2"
format_stamp: "Formatted at 2026-08-08 21:03:52 on dist-test-slave-t3q3"
server_key: "370d2942e98ea2bb2d836c22a189a7fd"
server_key_iv: "e30bd584bb5c560776b0d844ddcb8994"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.765475 4524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:53.782408 4524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:53.784868 4524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:53.785027 4524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:53.789470 4524 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:39815
I20260808 21:03:53.789534 4632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:39815 every 8 connection(s)
I20260808 21:03:53.789922 4524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:03:53.791649 4633 sys_catalog.cc:263] Verifying existing consensus state
I20260808 21:03:53.792413 4633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Bootstrap starting.
I20260808 21:03:53.796823 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 4524
I20260808 21:03:53.797185 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:45809
--local_ip_for_outbound_sockets=127.14.146.193
--tserver_master_addrs=127.14.146.254:39815
--webserver_port=39815
--webserver_interface=127.14.146.193
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:03:53.801800 4633 log.cc:824] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:53.803730 4633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:03:53.804041 4633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Bootstrap complete.
I20260808 21:03:53.806422 4633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:53.806643 4633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013800af4d1c4276a9c4c83eaf1f47a2, State: Initialized, Role: FOLLOWER
I20260808 21:03:53.806818 4633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:53.806882 4633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:03:53.806949 4633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:03:53.807003 4633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 21:03:53.808046 4633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:53.808220 4633 leader_election.cc:302] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 013800af4d1c4276a9c4c83eaf1f47a2; no voters:
I20260808 21:03:53.808390 4633 leader_election.cc:288] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 21:03:53.808425 4640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 21:03:53.808537 4640 raft_consensus.cc:686] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 2 LEADER]: Becoming Leader. State: Replica: 013800af4d1c4276a9c4c83eaf1f47a2, State: Running, Role: LEADER
I20260808 21:03:53.808670 4633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:03:53.808732 4640 consensus_queue.cc:237] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:53.809041 4641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } } }
I20260808 21:03:53.809314 4641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:53.809038 4640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 013800af4d1c4276a9c4c83eaf1f47a2. Latest consensus state: current_term: 2 leader_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } } }
I20260808 21:03:53.809556 4640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:53.809695 4652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:03:53.810492 4652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:03:53.810617 4652 catalog_manager.cc:1259] Loaded cluster ID: bfeb6d6a427441d79e29b7e429141130
I20260808 21:03:53.810689 4652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:03:53.811002 4652 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 21:03:53.816090 4652 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 21:03:53.818951 4652 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:03:53.819151 4652 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Loaded TSK: 0
I20260808 21:03:53.819381 4652 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 21:03:53.886327 4638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:53.886531 4638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:53.886555 4638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:53.887709 4638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:53.887764 4638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:53.887791 4638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:03:53.889325 4638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:45809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=39815
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:53.889585 4638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:53.889848 4638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:53.895596 4669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:53.895733 4638 server_base.cc:1034] running on GCE node
W20260808 21:03:53.895817 4670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:53.895567 4675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:53.896198 4638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:53.896485 4638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:53.897643 4638 hybrid_clock.cc:648] HybridClock initialized: now 1786223033897618 us; error 39 us; skew 500 ppm
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:53.900748 4638 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:03:53.901273 4638 webserver.cc:460] Webserver started at http://127.14.146.193:39815/ using document root <none> and password file <none>
I20260808 21:03:53.901535 4638 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:53.901597 4638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:53.902994 4638 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 21:03:53.903744 4684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:53.903942 4638 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:53.904038 4638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "1a7baa0210a24dd296f44f2c11e3879b"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b3f34afd74258af2ddaa50f7b343afab"
server_key_iv: "23e2a91dfef2d2bdd6de316a97fb57f2"
server_key_version: "encryptionkey@0"
I20260808 21:03:53.904455 4638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:53.918835 4638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:53.921263 4638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:53.921435 4638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:53.921700 4638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:53.922256 4695 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 21:03:53.923986 4638 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 21:03:53.924041 4638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 21:03:53.924131 4638 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 21:03:53.924798 4638 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 21:03:53.924846 4638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 21:03:53.924906 4695 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Bootstrap starting.
I20260808 21:03:53.932979 4638 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:45809
I20260808 21:03:53.933566 4638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:03:53.933818 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 4638
I20260808 21:03:53.934108 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:34799
--local_ip_for_outbound_sockets=127.14.146.194
--tserver_master_addrs=127.14.146.254:39815
--webserver_port=41721
--webserver_interface=127.14.146.194
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:03:53.936902 4695 log.cc:824] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:53.937291 4862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:45809 every 8 connection(s)
I20260808 21:03:53.939690 4695 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:03:53.940091 4695 tablet_bootstrap.cc:492] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Bootstrap complete.
I20260808 21:03:53.941417 4695 ts_tablet_manager.cc:1397] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.011s
I20260808 21:03:53.942806 4695 raft_consensus.cc:348] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.943135 4695 raft_consensus.cc:729] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7baa0210a24dd296f44f2c11e3879b, State: Initialized, Role: FOLLOWER
I20260808 21:03:53.943286 4695 consensus_queue.cc:260] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } } peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } }
I20260808 21:03:53.943567 4695 ts_tablet_manager.cc:1428] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:53.951629 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.937950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:58713 (local address 127.14.146.254:39815)
0808 21:03:53.939279 (+ 1329us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.939290 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.940129 (+ 839us) server_negotiation.cc:407] Connection header received
0808 21:03:53.940608 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.940617 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.940684 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.940807 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:53.941952 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.943344 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.945046 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.945432 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.945519 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.948143 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:53.948148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:53.948148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:53.948163 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:53.949857 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.950299 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.950302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.950303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.950395 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.950669 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.950670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.950670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.950903 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:53.950994 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.951304 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.951435 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1233,"thread_start_us":104,"threads_started":1}
I20260808 21:03:53.951629 4868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.937874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:58713)
0808 21:03:53.939384 (+ 1510us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.939438 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.940342 (+ 904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.941030 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.941034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.941472 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:53.941788 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.941797 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.943500 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.943501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.944953 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.944956 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.945536 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.945538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.945702 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.946300 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:53.946313 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:53.947988 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:53.949952 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.949959 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.949962 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.950194 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.950468 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.950469 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.950470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.950580 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.950986 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:53.950993 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:53.951128 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.951233 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.951421 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1462,"thread_start_us":85,"threads_started":1}
I20260808 21:03:53.952679 4863 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39815
I20260808 21:03:53.952792 4863 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:53.952981 4863 heartbeater.cc:511] Master 127.14.146.254:39815 requested a full tablet report, sending...
I20260808 21:03:53.953817 4575 ts_manager.cc:194] Registered new tserver with Master: 1a7baa0210a24dd296f44f2c11e3879b (127.14.146.193:45809)
I20260808 21:03:53.954952 4575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:58713
I20260808 21:03:53.955864 4863 heartbeater.cc:503] Master 127.14.146.254:39815 was elected leader, sending a full tablet report...
Aug 08 21:03:53 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223033, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.193@KRBTEST.COM
I20260808 21:03:53.963213 4872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.954434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:45809 (local address 127.0.0.1:60564)
0808 21:03:53.954679 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:53.954711 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:53.954785 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:53.954995 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:53.955001 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:53.955338 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:53.955399 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.955402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.956785 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.956786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.957358 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:53.957360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.957982 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.957983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:53.958038 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.958553 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:53.958557 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:53.959881 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:53.961835 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.961843 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.961845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.962089 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.962375 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:53.962377 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:53.962377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:53.962446 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:53.962824 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:53.962833 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:53.962900 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 21:03:53.962982 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 21:03:53.963118 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":105,"threads_started":1}
I20260808 21:03:53.963248 4875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:53.954513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60564 (local address 127.14.146.193:45809)
0808 21:03:53.954679 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:53.954683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:53.954786 (+ 103us) server_negotiation.cc:407] Connection header received
0808 21:03:53.954876 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:53.954878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:53.954893 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:53.954972 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:53.955496 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.956699 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.957441 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:53.957897 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:53.957974 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:53.959964 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:53.959973 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:53.959973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:53.959981 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:53.961730 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.962175 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.962179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.962179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.962262 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:53.962526 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:53.962527 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:53.962527 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:53.962715 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:53.962802 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:53.963040 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 21:03:53.963145 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260808 21:03:53.963745 4747 tablet_service.cc:1514] Processing DeleteTablet for tablet 9076c06a60bf4318994ddbb70091b852 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:53 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:60564
I20260808 21:03:53.964375 4876 tablet_replica.cc:330] stopping tablet replica
I20260808 21:03:53.964502 4876 raft_consensus.cc:2229] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:03:53.964600 4876 raft_consensus.cc:2258] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:03:53.964989 4876 ts_tablet_manager.cc:1905] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:03:53.967036 4876 ts_tablet_manager.cc:1918] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:03:53.967113 4876 log.cc:1196] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/9076c06a60bf4318994ddbb70091b852
I20260808 21:03:53.967389 4876 ts_tablet_manager.cc:1939] T 9076c06a60bf4318994ddbb70091b852 P 1a7baa0210a24dd296f44f2c11e3879b: Deleting consensus metadata
I20260808 21:03:53.967967 4549 catalog_manager.cc:4841] TS 1a7baa0210a24dd296f44f2c11e3879b (127.14.146.193:45809): tablet 9076c06a60bf4318994ddbb70091b852 (table test-table [id=f474667a2b114e07bc2351f5ba442049]) successfully deleted
W20260808 21:03:54.028216 4865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:54.028431 4865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:54.028457 4865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:54.029618 4865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:54.029660 4865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:54.029717 4865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:03:54.031250 4865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:34799
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=41721
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:54.031490 4865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:54.031738 4865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:54.037132 4882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:54.037067 4885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.037338 4865 server_base.cc:1034] running on GCE node
W20260808 21:03:54.037485 4881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.037670 4865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:54.037926 4865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:54.039090 4865 hybrid_clock.cc:648] HybridClock initialized: now 1786223034039079 us; error 25 us; skew 500 ppm
Aug 08 21:03:54 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:54.041709 4865 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:03:54.042225 4865 webserver.cc:460] Webserver started at http://127.14.146.194:41721/ using document root <none> and password file <none>
I20260808 21:03:54.042454 4865 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:54.042521 4865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:54.043979 4865 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.044695 4895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.044854 4865 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:03:54.044948 4865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "db583c4df6f1494e8d381fe66d5801b2"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b97903ea91b68847fdbad11ea5d72e41"
server_key_iv: "24331549f69f3a57f6a6ace385fe6ce7"
server_key_version: "encryptionkey@0"
I20260808 21:03:54.045279 4865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:54.051990 4865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:54.054025 4865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:54.054188 4865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:54.054418 4865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:54.054750 4865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:54.054785 4865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.054829 4865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:54.054857 4865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.060616 4865 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:34799
I20260808 21:03:54.060705 5061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:34799 every 8 connection(s)
I20260808 21:03:54.061050 4865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
Aug 08 21:03:54 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:54.070690 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.061768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:55567 (local address 127.14.146.254:39815)
0808 21:03:54.061829 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.061831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.062058 (+ 227us) server_negotiation.cc:407] Connection header received
0808 21:03:54.062558 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.062560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.062573 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.062628 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:54.063561 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.064119 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.065475 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.065851 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.065909 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.068157 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:54.068159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:54.068159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:54.068166 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:54.069572 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:54.069937 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:54.069938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:54.069938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:54.069993 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:54.070184 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:54.070185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:54.070185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:54.070294 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:54.070340 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.070552 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.070623 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 21:03:54.070842 5066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.061744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:55567)
0808 21:03:54.061923 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.061963 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:54.062448 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:54.062691 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:54.062694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:54.063285 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:54.063479 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.063484 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.064208 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.064209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.065360 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.065363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.065929 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.065930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.066057 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.066629 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:54.066638 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:54.068005 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:54.069647 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:54.069653 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:54.069655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:54.069869 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:54.070035 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:54.070036 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:54.070036 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:54.070133 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:54.070337 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:54.070340 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:54.070448 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 21:03:54.070524 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 21:03:54.070645 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":110,"threads_started":1}
I20260808 21:03:54.071148 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 4865
I20260808 21:03:54.071478 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:36473
--local_ip_for_outbound_sockets=127.14.146.195
--tserver_master_addrs=127.14.146.254:39815
--webserver_port=39085
--webserver_interface=127.14.146.195
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:03:54.071519 5062 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39815
I20260808 21:03:54.071645 5062 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:54.071825 5062 heartbeater.cc:511] Master 127.14.146.254:39815 requested a full tablet report, sending...
I20260808 21:03:54.072288 4575 ts_manager.cc:194] Registered new tserver with Master: db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799)
I20260808 21:03:54.072669 4575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:55567
W20260808 21:03:54.155268 5067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:54.155557 5067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:54.155602 5067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:54.156853 5067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:54.156898 5067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:54.156924 5067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:03:54.158325 5067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:36473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=39085
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:54.158506 5067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:54.158687 5067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:54.163865 5072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:54.163923 5073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.163928 5067 server_base.cc:1034] running on GCE node
W20260808 21:03:54.163865 5075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.164362 5067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:54.164639 5067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:54.165804 5067 hybrid_clock.cc:648] HybridClock initialized: now 1786223034165799 us; error 37 us; skew 500 ppm
Aug 08 21:03:54 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:54.168490 5067 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:03:54.168924 5067 webserver.cc:460] Webserver started at http://127.14.146.195:39085/ using document root <none> and password file <none>
I20260808 21:03:54.169126 5067 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:54.169178 5067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:54.170451 5067 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.170974 5084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.171160 5067 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.171244 5067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "792da70b7d6d411ca48defbe6be933e3"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "a32a46dc3b90200f623863cb1a548c79"
server_key_iv: "c3ec7efa44c35be7ca2e926d93ed1520"
server_key_version: "encryptionkey@0"
I20260808 21:03:54.171542 5067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:54.184223 5067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:54.186122 5067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:54.186230 5067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:54.186431 5067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:54.186677 5067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:54.186707 5067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.186728 5067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:54.186741 5067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.192262 5067 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:36473
I20260808 21:03:54.192400 5258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:36473 every 8 connection(s)
I20260808 21:03:54.192641 5067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:03:54.198035 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 5067
Aug 08 21:03:54 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:03:54.202207 4869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.193560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:51641 (local address 127.14.146.254:39815)
0808 21:03:54.193657 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.193659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.193754 (+ 95us) server_negotiation.cc:407] Connection header received
0808 21:03:54.194215 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.194216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.194226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.194275 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:54.195159 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.195644 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.196673 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.196857 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.196911 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.199239 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:54.199241 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:54.199241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:54.199251 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:54.200871 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:54.201238 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:54.201239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:54.201239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:54.201303 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:54.201538 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:54.201539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:54.201540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:54.201667 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:54.201757 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.202026 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.202117 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 21:03:54.202389 5263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.193471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:51641)
0808 21:03:54.193627 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.193669 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:54.194131 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:54.194337 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:54.194340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:54.194892 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:54.195081 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.195086 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.195726 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.195727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.196594 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.196596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.196930 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.196930 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.197030 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.197535 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:54.197544 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:54.199143 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:54.200954 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:54.200960 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:54.200962 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:54.201173 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:54.201362 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:54.201363 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:54.201363 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:54.201460 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:54.201746 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:54.201753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:54.201879 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 21:03:54.201986 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 21:03:54.202143 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260808 21:03:54.202855 5261 heartbeater.cc:347] Connected to a master server at 127.14.146.254:39815
I20260808 21:03:54.202975 5261 heartbeater.cc:464] Registering TS with master...
I20260808 21:03:54.203176 5261 heartbeater.cc:511] Master 127.14.146.254:39815 requested a full tablet report, sending...
I20260808 21:03:54.203596 4575 ts_manager.cc:194] Registered new tserver with Master: 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
I20260808 21:03:54.203917 4575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:51641
I20260808 21:03:54.205605 5265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.198439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34008 (local address 127.14.146.254:39815)
0808 21:03:54.198560 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.198562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.198590 (+ 28us) server_negotiation.cc:407] Connection header received
0808 21:03:54.198659 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.198660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.198671 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.198742 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:54.199357 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.199963 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.201140 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.201448 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.201520 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.202851 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:54.202852 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:54.202852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:54.202859 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:54.204478 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:54.204813 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:54.204814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:54.204814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:54.204870 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:54.205083 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:54.205084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:54.205084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:54.205197 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:54.205378 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.205416 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.205493 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":55,"threads_started":1}
I20260808 21:03:54.206373 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:03:54.209019 5265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.206689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34016 (local address 127.14.146.254:39815)
0808 21:03:54.206723 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.206725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.206828 (+ 103us) server_negotiation.cc:407] Connection header received
0808 21:03:54.206897 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.206897 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.206924 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.206970 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:03:54.207064 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.207489 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.208329 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.208622 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.208677 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.208810 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:03:54.208895 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:03:54.208949 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.208961 (+ 12us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.208977 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 21:03:54.209296 4575 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34016:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:03:54.210999 4575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:03:54.213452 4747 tablet_service.cc:1467] Processing CreateTablet for tablet ceb0f6a0bd6a4f55bc60a79e034fb144 (DEFAULT_TABLE table=test-table [id=d343aa35da82440b917e81f62c5689df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:54.213702 4747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb0f6a0bd6a4f55bc60a79e034fb144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:54.215314 4695 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Bootstrap starting.
I20260808 21:03:54.215642 4695 tablet_bootstrap.cc:654] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:54.216235 4695 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: No bootstrap required, opened a new log
I20260808 21:03:54.216293 4695 ts_tablet_manager.cc:1397] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 21:03:54.216647 4695 raft_consensus.cc:348] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.216732 4695 raft_consensus.cc:374] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:54.216775 4695 raft_consensus.cc:729] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7baa0210a24dd296f44f2c11e3879b, State: Initialized, Role: FOLLOWER
I20260808 21:03:54.216830 4695 consensus_queue.cc:260] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.216921 4695 ts_tablet_manager.cc:1428] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 21:03:54.217264 4872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.212950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:34799 (local address 127.0.0.1:35410)
0808 21:03:54.212983 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.213009 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:54.213045 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:54.213519 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:54.213520 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:54.213521 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:54.213573 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.213575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.214656 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.214657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.215674 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.215677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.216970 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.216971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.217046 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.217071 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 21:03:54.217138 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 21:03:54.217195 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 21:03:54.217337 5269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.213112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35410 (local address 127.14.146.194:34799)
0808 21:03:54.213333 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.213338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.213349 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:03:54.213397 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.213399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.213417 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.213500 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:54.213642 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.214552 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.215994 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.216692 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.216792 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.216857 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.217198 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.217244 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":107,"threads_started":1}
I20260808 21:03:54.217378 5268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.213063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:36473 (local address 127.0.0.1:53184)
0808 21:03:54.213216 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.213228 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:54.213296 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:54.213785 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:54.213786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:54.213788 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:54.213823 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.213824 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.215115 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.215116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.216172 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.216175 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.217125 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.217126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.217195 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.217200 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:03:54.217232 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 21:03:54.217277 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
I20260808 21:03:54.217721 5270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.213312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53184 (local address 127.14.146.195:36473)
0808 21:03:54.213512 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.213516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.213527 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:03:54.213667 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.213670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.213686 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.213929 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:54.214003 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.214991 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.216261 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.217014 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.217484 (+ 470us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.217552 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.217596 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.217644 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":100,"threads_started":1}
I20260808 21:03:54.218043 4957 tablet_service.cc:1467] Processing CreateTablet for tablet ceb0f6a0bd6a4f55bc60a79e034fb144 (DEFAULT_TABLE table=test-table [id=d343aa35da82440b917e81f62c5689df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:54.218443 4957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb0f6a0bd6a4f55bc60a79e034fb144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:54.220770 5149 tablet_service.cc:1467] Processing CreateTablet for tablet ceb0f6a0bd6a4f55bc60a79e034fb144 (DEFAULT_TABLE table=test-table [id=d343aa35da82440b917e81f62c5689df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:03:54.221155 5149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb0f6a0bd6a4f55bc60a79e034fb144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:03:54.221639 5272 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Bootstrap starting.
I20260808 21:03:54.222295 5272 tablet_bootstrap.cc:654] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:54.222774 5272 log.cc:824] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:54.223541 5272 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: No bootstrap required, opened a new log
I20260808 21:03:54.223632 5272 ts_tablet_manager.cc:1397] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:03:54.224604 5274 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: Bootstrap starting.
I20260808 21:03:54.225332 5274 tablet_bootstrap.cc:654] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: Neither blocks nor log segments found. Creating new log.
I20260808 21:03:54.225802 5272 raft_consensus.cc:348] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.225965 5274 log.cc:824] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:54.225989 5272 raft_consensus.cc:374] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:54.226028 5272 raft_consensus.cc:729] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db583c4df6f1494e8d381fe66d5801b2, State: Initialized, Role: FOLLOWER
I20260808 21:03:54.226159 5272 consensus_queue.cc:260] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.226487 5272 ts_tablet_manager.cc:1428] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:03:54.226511 5062 heartbeater.cc:503] Master 127.14.146.254:39815 was elected leader, sending a full tablet report...
I20260808 21:03:54.226845 5274 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: No bootstrap required, opened a new log
I20260808 21:03:54.226919 5274 ts_tablet_manager.cc:1397] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:03:54.228657 5274 raft_consensus.cc:348] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.228796 5274 raft_consensus.cc:374] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:03:54.228819 5274 raft_consensus.cc:729] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 792da70b7d6d411ca48defbe6be933e3, State: Initialized, Role: FOLLOWER
I20260808 21:03:54.228960 5274 consensus_queue.cc:260] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.229233 5274 ts_tablet_manager.cc:1428] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 21:03:54.229285 5261 heartbeater.cc:503] Master 127.14.146.254:39815 was elected leader, sending a full tablet report...
W20260808 21:03:54.311579 5063 tablet.cc:2369] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:03:54.331552 4871 raft_consensus.cc:482] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:03:54.331705 4871 raft_consensus.cc:504] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.332023 4871 leader_election.cc:288] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
I20260808 21:03:54.335018 4868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.332250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:34799 (local address 127.14.146.193:41421)
0808 21:03:54.332317 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.332330 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:54.332418 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:54.332598 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:54.332600 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:54.332601 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:54.332675 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.332677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.333361 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.333362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.334127 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.334129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.334697 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.334698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.334802 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.334823 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 21:03:54.334892 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 21:03:54.334939 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 21:03:54.335018 5269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.332389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:41421 (local address 127.14.146.194:34799)
0808 21:03:54.332446 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.332448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.332458 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:03:54.332492 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.332493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.332503 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.332593 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:54.332764 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.333265 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.334233 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.334611 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.334700 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.334709 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.334912 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.334948 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 21:03:54.335265 5270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.332463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:57727 (local address 127.14.146.195:36473)
0808 21:03:54.332510 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.332512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.332631 (+ 119us) server_negotiation.cc:407] Connection header received
0808 21:03:54.332699 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.332700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.332710 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.332783 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:03:54.332963 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.333436 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.334376 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.334765 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.334851 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.334859 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.335149 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.335198 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:03:54.335352 5279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.332367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:36473 (local address 127.14.146.193:57727)
0808 21:03:54.332552 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.332561 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:54.332632 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:54.332787 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:54.332788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:54.332789 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:03:54.332875 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.332877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.333525 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.333526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.334279 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:54.334281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.334880 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.334881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:54.334971 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.334974 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:03:54.335201 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 21:03:54.335244 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":103,"threads_started":1}
I20260808 21:03:54.335434 4985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb0f6a0bd6a4f55bc60a79e034fb144" candidate_uuid: "1a7baa0210a24dd296f44f2c11e3879b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db583c4df6f1494e8d381fe66d5801b2" is_pre_election: true
I20260808 21:03:54.335595 4985 raft_consensus.cc:2454] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7baa0210a24dd296f44f2c11e3879b in term 0.
I20260808 21:03:54.335708 5179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb0f6a0bd6a4f55bc60a79e034fb144" candidate_uuid: "1a7baa0210a24dd296f44f2c11e3879b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "792da70b7d6d411ca48defbe6be933e3" is_pre_election: true
I20260808 21:03:54.335847 4686 leader_election.cc:302] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b, db583c4df6f1494e8d381fe66d5801b2; no voters:
I20260808 21:03:54.335893 5179 raft_consensus.cc:2454] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a7baa0210a24dd296f44f2c11e3879b in term 0.
I20260808 21:03:54.335968 4871 raft_consensus.cc:2781] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:03:54.336026 4871 raft_consensus.cc:482] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:03:54.336086 4871 raft_consensus.cc:3037] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:54.336807 4871 raft_consensus.cc:504] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.336930 4871 leader_election.cc:288] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 1 election: Requested vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
I20260808 21:03:54.337111 5179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb0f6a0bd6a4f55bc60a79e034fb144" candidate_uuid: "1a7baa0210a24dd296f44f2c11e3879b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "792da70b7d6d411ca48defbe6be933e3"
I20260808 21:03:54.337186 5179 raft_consensus.cc:3037] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:54.337921 5179 raft_consensus.cc:2454] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7baa0210a24dd296f44f2c11e3879b in term 1.
I20260808 21:03:54.338049 4985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb0f6a0bd6a4f55bc60a79e034fb144" candidate_uuid: "1a7baa0210a24dd296f44f2c11e3879b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db583c4df6f1494e8d381fe66d5801b2"
I20260808 21:03:54.338119 4686 leader_election.cc:302] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b, 792da70b7d6d411ca48defbe6be933e3; no voters:
I20260808 21:03:54.338140 4985 raft_consensus.cc:3037] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:03:54.338193 4871 raft_consensus.cc:2781] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:03:54.338336 4871 raft_consensus.cc:686] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 LEADER]: Becoming Leader. State: Replica: 1a7baa0210a24dd296f44f2c11e3879b, State: Running, Role: LEADER
I20260808 21:03:54.338420 4871 consensus_queue.cc:237] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.339129 4985 raft_consensus.cc:2454] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a7baa0210a24dd296f44f2c11e3879b in term 1.
I20260808 21:03:54.339327 4575 catalog_manager.cc:5495] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a7baa0210a24dd296f44f2c11e3879b (127.14.146.193). New cstate: current_term: 1 leader_uuid: "1a7baa0210a24dd296f44f2c11e3879b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } health_report { overall_health: HEALTHY } } }
I20260808 21:03:54.365069 4875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.362571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60568 (local address 127.14.146.193:45809)
0808 21:03:54.362635 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:54.362637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:54.362646 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:03:54.362698 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:54.362699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:54.362726 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:54.362788 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:03:54.362905 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.363429 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.364186 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:54.364391 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:54.364444 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:54.364655 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:03:54.364759 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:03:54.364846 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:54.364928 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 21:03:54.364949 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 21:03:54.366662 5179 raft_consensus.cc:1261] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 1 FOLLOWER]: Refusing update from remote peer 1a7baa0210a24dd296f44f2c11e3879b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:03:54.366684 4985 raft_consensus.cc:1261] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 1 FOLLOWER]: Refusing update from remote peer 1a7baa0210a24dd296f44f2c11e3879b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:03:54.367025 4871 consensus_queue.cc:1035] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [LEADER]: Connected to new peer: Peer: permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:03:54.367233 5280 consensus_queue.cc:1035] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [LEADER]: Connected to new peer: Peer: permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:03:54.370339 5285 mvcc.cc:205] Tried to move back new op lower bound from 7316369548763160576 to 7316369548650708992. Current Snapshot: MvccSnapshot[applied={T|T < 7316369548763160576}]
I20260808 21:03:54.370406 5286 mvcc.cc:205] Tried to move back new op lower bound from 7316369548763160576 to 7316369548650708992. Current Snapshot: MvccSnapshot[applied={T|T < 7316369548763160576}]
I20260808 21:03:54.371129 5283 mvcc.cc:205] Tried to move back new op lower bound from 7316369548763160576 to 7316369548650708992. Current Snapshot: MvccSnapshot[applied={T|T < 7316369548763160576 or (T in {7316369548763160576})}]
I20260808 21:03:54.372556 4575 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:03:54.372678 4575 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34016:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:03:54.373458 4575 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Sending DeleteTablet for 3 replicas of tablet ceb0f6a0bd6a4f55bc60a79e034fb144
I20260808 21:03:54.373783 4747 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb0f6a0bd6a4f55bc60a79e034fb144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:54 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:60564
I20260808 21:03:54.373848 4957 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb0f6a0bd6a4f55bc60a79e034fb144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:54 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:35410
I20260808 21:03:54.373845 5149 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb0f6a0bd6a4f55bc60a79e034fb144 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:03:54 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:53184
I20260808 21:03:54.374047 4876 tablet_replica.cc:330] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: stopping tablet replica
I20260808 21:03:54.374091 5297 tablet_replica.cc:330] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: stopping tablet replica
I20260808 21:03:54.374135 4876 raft_consensus.cc:2229] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:03:54.374194 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 4638
I20260808 21:03:54.374224 4876 raft_consensus.cc:2258] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:03:54.374226 5297 raft_consensus.cc:2229] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:03:54.374329 5297 raft_consensus.cc:2258] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:03:54.374480 5298 tablet_replica.cc:330] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: stopping tablet replica
I20260808 21:03:54.374563 5298 raft_consensus.cc:2229] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:03:54.374651 5298 raft_consensus.cc:2258] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:03:54.379829 5298 ts_tablet_manager.cc:1905] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:03:54.381927 5298 ts_tablet_manager.cc:1918] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:03:54.381989 5298 log.cc:1196] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/ceb0f6a0bd6a4f55bc60a79e034fb144
I20260808 21:03:54.382202 5298 ts_tablet_manager.cc:1939] T ceb0f6a0bd6a4f55bc60a79e034fb144 P db583c4df6f1494e8d381fe66d5801b2: Deleting consensus metadata
I20260808 21:03:54.382624 4548 catalog_manager.cc:4841] TS db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799): tablet ceb0f6a0bd6a4f55bc60a79e034fb144 (table test-table [id=d343aa35da82440b917e81f62c5689df]) successfully deleted
I20260808 21:03:54.383368 5297 ts_tablet_manager.cc:1905] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:03:54.385519 5297 ts_tablet_manager.cc:1918] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:03:54.385627 5297 log.cc:1196] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/ceb0f6a0bd6a4f55bc60a79e034fb144
I20260808 21:03:54.385886 5297 ts_tablet_manager.cc:1939] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 792da70b7d6d411ca48defbe6be933e3: Deleting consensus metadata
I20260808 21:03:54.386323 4548 catalog_manager.cc:4841] TS 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473): tablet ceb0f6a0bd6a4f55bc60a79e034fb144 (table test-table [id=d343aa35da82440b917e81f62c5689df]) successfully deleted
W20260808 21:03:54.389616 4549 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:45809 (error 108)
W20260808 21:03:54.390166 5268 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:03:54.390041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:45809 (local address 127.0.0.1:60582)
0808 21:03:54.390097 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.390132 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:45809: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 21:03:54.390445 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 4865
W20260808 21:03:54.390331 4549 catalog_manager.cc:4584] TS 1a7baa0210a24dd296f44f2c11e3879b (127.14.146.193:45809): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ceb0f6a0bd6a4f55bc60a79e034fb144: Network error: Client connection negotiation failed: client connection to 127.14.146.193:45809: connect: Connection reset by peer (error 104)
I20260808 21:03:54.402828 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 5067
I20260808 21:03:54.412451 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 4524
I20260808 21:03:54.421367 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39815
--webserver_interface=127.14.146.254
--webserver_port=44147
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:39815
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:54.505117 5300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:54.505337 5300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:54.505360 5300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:54.506525 5300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:03:54.506565 5300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:54.506580 5300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:54.506593 5300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:03:54.506606 5300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:03:54.508024 5300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:39815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=44147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:54.508298 5300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:54.508481 5300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:54.513474 5308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:54.513502 5310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.513643 5300 server_base.cc:1034] running on GCE node
W20260808 21:03:54.513447 5307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.513929 5300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:54.514266 5300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:54.515432 5300 hybrid_clock.cc:648] HybridClock initialized: now 1786223034515417 us; error 43 us; skew 500 ppm
Aug 08 21:03:54 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:54.518025 5300 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:03:54.518501 5300 webserver.cc:460] Webserver started at http://127.14.146.254:44147/ using document root <none> and password file <none>
I20260808 21:03:54.518754 5300 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:54.518826 5300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:54.520291 5300 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.521031 5319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.521230 5300 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.521324 5300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "013800af4d1c4276a9c4c83eaf1f47a2"
format_stamp: "Formatted at 2026-08-08 21:03:52 on dist-test-slave-t3q3"
server_key: "370d2942e98ea2bb2d836c22a189a7fd"
server_key_iv: "e30bd584bb5c560776b0d844ddcb8994"
server_key_version: "encryptionkey@0"
I20260808 21:03:54.521663 5300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:54.536017 5300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:54.537920 5300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:54.538102 5300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:54.542336 5300 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:39815
I20260808 21:03:54.542375 5403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:39815 every 8 connection(s)
I20260808 21:03:54.542780 5300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:03:54.544415 5405 sys_catalog.cc:263] Verifying existing consensus state
I20260808 21:03:54.545095 5405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Bootstrap starting.
I20260808 21:03:54.546948 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 5300
I20260808 21:03:54.547260 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:45809
--local_ip_for_outbound_sockets=127.14.146.193
--tserver_master_addrs=127.14.146.254:39815
--webserver_port=39815
--webserver_interface=127.14.146.193
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:03:54.554365 5405 log.cc:824] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:54.556742 5405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:03:54.557049 5405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2: Bootstrap complete.
I20260808 21:03:54.559317 5405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:54.559562 5405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 013800af4d1c4276a9c4c83eaf1f47a2, State: Initialized, Role: FOLLOWER
I20260808 21:03:54.559755 5405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:54.559839 5405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:03:54.559891 5405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:03:54.559942 5405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 2 FOLLOWER]: Advancing to term 3
I20260808 21:03:54.560971 5405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:54.561094 5405 leader_election.cc:302] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 013800af4d1c4276a9c4c83eaf1f47a2; no voters:
I20260808 21:03:54.561298 5405 leader_election.cc:288] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 21:03:54.561334 5410 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 21:03:54.561448 5410 raft_consensus.cc:686] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [term 3 LEADER]: Becoming Leader. State: Replica: 013800af4d1c4276a9c4c83eaf1f47a2, State: Running, Role: LEADER
I20260808 21:03:54.561535 5410 consensus_queue.cc:237] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } }
I20260808 21:03:54.561578 5405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:03:54.561836 5412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 013800af4d1c4276a9c4c83eaf1f47a2. Latest consensus state: current_term: 3 leader_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } } }
I20260808 21:03:54.561937 5412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:54.561834 5413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "013800af4d1c4276a9c4c83eaf1f47a2" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39815 } } }
I20260808 21:03:54.562325 5413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 013800af4d1c4276a9c4c83eaf1f47a2 [sys.catalog]: This master's current role is: LEADER
I20260808 21:03:54.562460 5417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:03:54.563222 5417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:03:54.563318 5417 catalog_manager.cc:1259] Loaded cluster ID: bfeb6d6a427441d79e29b7e429141130
I20260808 21:03:54.563341 5417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 21:03:54.563683 5417 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb6a9ea39ad google::LogMessage::Fail() at ??:0
@ 0x7fb6a9ea688a google::LogMessage::SendToLog() at ??:0
@ 0x7fb6a9ea34de google::LogMessage::Flush() at ??:0
@ 0x7fb6a9ea4a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb6b1dc40f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fb6b1dcd8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb6abd710d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb6abd66954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb6acbca6db start_thread at ??:0
@ 0x7fb6a89a161f clone at ??:0
W20260808 21:03:54.644594 5407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:54.644829 5407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:54.644868 5407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:54.646008 5407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:54.646076 5407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:54.646122 5407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:03:54.647608 5407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:45809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=39815
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:54.647897 5407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:54.648190 5407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:54.653383 5460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:54.653420 5461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.653611 5407 server_base.cc:1034] running on GCE node
W20260808 21:03:54.653733 5465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.653942 5407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:54.654198 5407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:54.655375 5407 hybrid_clock.cc:648] HybridClock initialized: now 1786223034655352 us; error 40 us; skew 500 ppm
Aug 08 21:03:54 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:54.657930 5407 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:03:54.658403 5407 webserver.cc:460] Webserver started at http://127.14.146.193:39815/ using document root <none> and password file <none>
I20260808 21:03:54.658648 5407 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:54.658730 5407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:54.660182 5407 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.660931 5477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.661128 5407 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.661244 5407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "1a7baa0210a24dd296f44f2c11e3879b"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b3f34afd74258af2ddaa50f7b343afab"
server_key_iv: "23e2a91dfef2d2bdd6de316a97fb57f2"
server_key_version: "encryptionkey@0"
I20260808 21:03:54.661597 5407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:54.685282 5407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:54.687635 5407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:54.687788 5407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:54.688051 5407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:54.688587 5488 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 21:03:54.690573 5407 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 21:03:54.690637 5407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 21:03:54.690685 5407 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 21:03:54.691322 5407 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 21:03:54.691378 5407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 21:03:54.691454 5488 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Bootstrap starting.
I20260808 21:03:54.698962 5407 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:45809
I20260808 21:03:54.699126 5658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:45809 every 8 connection(s)
I20260808 21:03:54.699425 5407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:03:54.702786 5488 log.cc:824] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:03:54.704285 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 5407
I20260808 21:03:54.704574 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:34799
--local_ip_for_outbound_sockets=127.14.146.194
--tserver_master_addrs=127.14.146.254:39815
--webserver_port=41721
--webserver_interface=127.14.146.194
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:03:54.705917 5488 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:03:54.706260 5488 tablet_bootstrap.cc:492] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Bootstrap complete.
I20260808 21:03:54.707510 5488 ts_tablet_manager.cc:1397] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.009s
I20260808 21:03:54.709466 5488 raft_consensus.cc:348] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.709864 5488 raft_consensus.cc:729] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a7baa0210a24dd296f44f2c11e3879b, State: Initialized, Role: FOLLOWER
I20260808 21:03:54.710029 5488 consensus_queue.cc:260] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:54.710366 5488 ts_tablet_manager.cc:1428] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s
W20260808 21:03:54.794589 5665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:54.794791 5665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:54.794814 5665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:54.795992 5665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:54.796036 5665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:54.796115 5665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:03:54.799084 5665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:34799
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=41721
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:54.799353 5665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:54.799619 5665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:54.804768 5678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:54.804801 5676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:54.805213 5682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.805372 5665 server_base.cc:1034] running on GCE node
I20260808 21:03:54.805589 5665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260808 21:03:54.805701 5663 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:03:54.700294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:45161)
0808 21:03:54.700479 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.700525 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:54.700987 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:54.805496 (+104509us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":100,"threads_started":1}
I20260808 21:03:54.805897 5665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260808 21:03:54.805962 5659 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:39815 (0 consecutive failures): Network error: Failed to ping master at 127.14.146.254:39815: Client connection negotiation failed: client connection to 127.14.146.254:39815: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 21:03:54.806293 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.806167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:48745)
0808 21:03:54.806227 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.806268 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 21:03:54.806610 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.806531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:47707)
0808 21:03:54.806572 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.806595 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 21:03:54.806743 5659 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 21:03:54.807062 5665 hybrid_clock.cc:648] HybridClock initialized: now 1786223034807044 us; error 34 us; skew 500 ppm
Aug 08 21:03:54 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:54.809526 5665 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:03:54.809911 5665 webserver.cc:460] Webserver started at http://127.14.146.194:41721/ using document root <none> and password file <none>
I20260808 21:03:54.810107 5665 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:54.810149 5665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:54.811384 5665 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.811928 5694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.812134 5665 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:03:54.812209 5665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "db583c4df6f1494e8d381fe66d5801b2"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "b97903ea91b68847fdbad11ea5d72e41"
server_key_iv: "24331549f69f3a57f6a6ace385fe6ce7"
server_key_version: "encryptionkey@0"
I20260808 21:03:54.812496 5665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:54.826337 5665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:54.828212 5665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:54.828351 5665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:54.828533 5665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:54.828790 5665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:54.828821 5665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.828842 5665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:54.828855 5665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.834867 5665 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:34799
I20260808 21:03:54.834954 5858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:34799 every 8 connection(s)
I20260808 21:03:54.835285 5665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:03:54.836383 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.835972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:57629)
0808 21:03:54.836155 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.836246 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":103,"threads_started":1}
W20260808 21:03:54.836805 5859 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:39815 (0 consecutive failures): Network error: Failed to ping master at 127.14.146.254:39815: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
I20260808 21:03:54.837080 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.836994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:49217)
0808 21:03:54.837038 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.837064 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 21:03:54.837348 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.837292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:37719)
0808 21:03:54.837316 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.837335 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260808 21:03:54.837466 5859 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 21:03:54.841657 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 5665
I20260808 21:03:54.841873 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:36473
--local_ip_for_outbound_sockets=127.14.146.195
--tserver_master_addrs=127.14.146.254:39815
--webserver_port=39085
--webserver_interface=127.14.146.195
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:03:54.926308 5863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:03:54.926522 5863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:03:54.926546 5863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:03:54.927711 5863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:03:54.927755 5863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:03:54.927805 5863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:03:54.929315 5863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:36473
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=39085
--tserver_master_addrs=127.14.146.254:39815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:03:54.929555 5863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:03:54.929786 5863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:03:54.934995 5875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:54.934965 5872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:03:54.934958 5870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:03:54.935309 5863 server_base.cc:1034] running on GCE node
I20260808 21:03:54.935528 5863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:03:54.935789 5863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:03:54.936959 5863 hybrid_clock.cc:648] HybridClock initialized: now 1786223034936951 us; error 36 us; skew 500 ppm
Aug 08 21:03:54 dist-test-slave-t3q3 krb5kdc[3697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:03:54.939464 5863 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:03:54.939857 5863 webserver.cc:460] Webserver started at http://127.14.146.195:39085/ using document root <none> and password file <none>
I20260808 21:03:54.940104 5863 fs_manager.cc:359] Metadata directory not provided
I20260808 21:03:54.940165 5863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:03:54.941444 5863 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.942116 5887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.942342 5863 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:03:54.942442 5863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "792da70b7d6d411ca48defbe6be933e3"
format_stamp: "Formatted at 2026-08-08 21:03:53 on dist-test-slave-t3q3"
server_key: "a32a46dc3b90200f623863cb1a548c79"
server_key_iv: "c3ec7efa44c35be7ca2e926d93ed1520"
server_key_version: "encryptionkey@0"
I20260808 21:03:54.942824 5863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:03:54.974287 5863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:03:54.976769 5863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:03:54.976886 5863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:03:54.977092 5863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:03:54.977430 5863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:03:54.977465 5863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.977511 5863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:03:54.977546 5863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:03:54.983398 5863 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:36473
I20260808 21:03:54.983518 6060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:36473 every 8 connection(s)
I20260808 21:03:54.983853 5863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:03:54.984999 6063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.984619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:37453)
0808 21:03:54.984777 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.984857 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
W20260808 21:03:54.985400 6061 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:39815 (0 consecutive failures): Network error: Failed to ping master at 127.14.146.254:39815: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
I20260808 21:03:54.985690 6063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.985590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:45551)
0808 21:03:54.985641 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.985672 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 21:03:54.985985 6063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:54.985895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:34821)
0808 21:03:54.985940 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:54.985964 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 21:03:54.986090 6061 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 21:03:54.988037 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 5863
I20260808 21:03:55.807442 6065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:55.807169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:55131)
0808 21:03:55.807344 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:55.807391 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":69,"threads_started":1}
I20260808 21:03:55.838129 6067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:55.837811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:52835)
0808 21:03:55.838017 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:55.838066 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":122,"threads_started":1}
I20260808 21:03:55.986745 6068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:55.986446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:41163)
0808 21:03:55.986662 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:55.986696 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":148,"threads_started":1}
I20260808 21:03:56.072716 6073 raft_consensus.cc:482] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:03:56.072849 6073 raft_consensus.cc:504] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:56.073166 6073 leader_election.cc:288] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
Aug 08 21:03:56 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.194@KRBTEST.COM
Aug 08 21:03:56 dist-test-slave-t3q3 krb5kdc[3697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223034, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.195@KRBTEST.COM
I20260808 21:03:56.084367 6065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:56.073372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:34799 (local address 127.14.146.193:60507)
0808 21:03:56.073433 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:56.073445 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:56.073505 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:56.074599 (+ 1094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:56.074601 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:56.074954 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:56.075159 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:56.075165 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:56.076346 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:56.076347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:56.077138 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:56.077141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:56.077737 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:56.077738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:56.077858 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:56.078508 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:56.078513 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:56.079955 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:56.082274 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:56.082283 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:56.082285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:56.082605 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:56.082933 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:56.082934 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:56.082934 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:56.083078 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:56.083674 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:56.083681 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:56.083883 (+ 202us) client_negotiation.cc:769] Sending connection context
0808 21:03:56.084047 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 21:03:56.084241 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":26}
I20260808 21:03:56.084501 6076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:56.073513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:36473 (local address 127.14.146.193:35343)
0808 21:03:56.073633 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:56.073646 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:03:56.073711 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:03:56.074680 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:03:56.074682 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:03:56.074941 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:03:56.075159 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:56.075164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:56.076381 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:56.076382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:56.077138 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:03:56.077139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:03:56.077781 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:03:56.077782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:03:56.077862 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:56.078449 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:03:56.078457 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:03:56.080335 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:03:56.082826 (+ 2491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:56.082828 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:56.082828 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:56.083049 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:56.083321 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:03:56.083322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:03:56.083322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:03:56.083387 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:03:56.084107 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:03:56.084108 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:03:56.084161 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 21:03:56.084231 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 21:03:56.084307 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":48,"thread_start_us":58,"threads_started":1}
I20260808 21:03:56.084658 6075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:56.073480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:60507 (local address 127.14.146.194:34799)
0808 21:03:56.073664 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:56.073675 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:56.073733 (+ 58us) server_negotiation.cc:407] Connection header received
0808 21:03:56.074330 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:56.074334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:56.074395 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:56.074551 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:56.075287 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:56.076256 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:56.077234 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:56.077647 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:56.077764 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:56.080093 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:56.080109 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:56.080109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:56.080120 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:56.082127 (+ 2007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:56.082733 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:56.082736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:56.082737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:56.082847 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:56.083169 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:56.083170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:56.083170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:56.083541 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:56.083667 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:56.084171 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 21:03:56.084328 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":60,"threads_started":1}
I20260808 21:03:56.085367 6077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:56.073626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:35343 (local address 127.14.146.195:36473)
0808 21:03:56.073812 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 21:03:56.073819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 21:03:56.073849 (+ 30us) server_negotiation.cc:407] Connection header received
0808 21:03:56.074360 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:03:56.074362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:03:56.074400 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:03:56.074551 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:03:56.075322 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:56.076264 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:56.077277 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:03:56.077671 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:03:56.077813 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:03:56.080468 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:03:56.080472 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:03:56.080472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:03:56.080484 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:03:56.082727 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:56.083139 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:56.083142 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:56.083142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:56.083238 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:03:56.083454 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:03:56.083455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:03:56.083456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:03:56.083768 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:03:56.083852 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 21:03:56.085117 (+ 1265us) server_negotiation.cc:299] Negotiation successful
0808 21:03:56.085251 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":85,"threads_started":1}
W20260808 21:03:56.085513 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
W20260808 21:03:56.092310 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
I20260808 21:03:56.092417 5479 leader_election.cc:302] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b; no voters: 792da70b7d6d411ca48defbe6be933e3, db583c4df6f1494e8d381fe66d5801b2
I20260808 21:03:56.092572 6073 raft_consensus.cc:2726] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:03:56.808324 6080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:56.808012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:41959)
0808 21:03:56.808243 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:56.808277 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":147,"threads_started":1}
I20260808 21:03:56.838768 6081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:56.838563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:52293)
0808 21:03:56.838690 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:56.838732 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":80,"threads_started":1}
I20260808 21:03:56.987421 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:56.987235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:58877)
0808 21:03:56.987351 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:56.987384 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260808 21:03:57.809003 6084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:57.808768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:34289)
0808 21:03:57.808917 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:57.808955 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":119,"threads_started":1}
I20260808 21:03:57.835892 6086 raft_consensus.cc:482] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:03:57.836037 6086 raft_consensus.cc:504] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:57.836268 6086 leader_election.cc:288] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
W20260808 21:03:57.836827 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
W20260808 21:03:57.836902 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
I20260808 21:03:57.836920 5479 leader_election.cc:302] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b; no voters: 792da70b7d6d411ca48defbe6be933e3, db583c4df6f1494e8d381fe66d5801b2
I20260808 21:03:57.837059 6086 raft_consensus.cc:2726] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:03:57.839417 6087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:57.839222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:42333)
0808 21:03:57.839353 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:57.839381 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
I20260808 21:03:57.988102 6088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:57.987833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:49567)
0808 21:03:57.987981 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:57.988020 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":75,"threads_started":1}
I20260808 21:03:58.809726 6089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:58.809482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:35457)
0808 21:03:58.809627 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:58.809666 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":76,"threads_started":1}
I20260808 21:03:58.840207 6090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:58.839881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:52047)
0808 21:03:58.840030 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:58.840144 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260808 21:03:58.988741 6091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:58.988526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:43983)
0808 21:03:58.988663 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:58.988700 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260808 21:03:59.567407 6092 raft_consensus.cc:482] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:03:59.567516 6092 raft_consensus.cc:504] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:03:59.567740 6092 leader_election.cc:288] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
W20260808 21:03:59.568261 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
W20260808 21:03:59.568352 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
I20260808 21:03:59.568389 5479 leader_election.cc:302] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b; no voters: 792da70b7d6d411ca48defbe6be933e3, db583c4df6f1494e8d381fe66d5801b2
I20260808 21:03:59.568486 6092 raft_consensus.cc:2726] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:03:59.810519 6093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:59.810293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:58899)
0808 21:03:59.810435 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:59.810474 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":65,"threads_started":1}
I20260808 21:03:59.840898 6094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:59.840685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:38697)
0808 21:03:59.840823 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:59.840854 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260808 21:03:59.989452 6096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:03:59.989241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:56489)
0808 21:03:59.989372 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 21:03:59.989413 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260808 21:04:00.811446 6097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:00.811177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:49709)
0808 21:04:00.811353 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:00.811397 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":94,"threads_started":1}
I20260808 21:04:00.841617 6098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:00.841375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:52019)
0808 21:04:00.841534 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:00.841570 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
I20260808 21:04:00.990200 6100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:00.989958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:36943)
0808 21:04:00.990119 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:00.990158 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":82,"threads_started":1}
I20260808 21:04:01.812321 6104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:01.812024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:42369)
0808 21:04:01.812224 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:01.812271 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":129,"threads_started":1}
I20260808 21:04:01.842407 6105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:01.842178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:41545)
0808 21:04:01.842320 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:01.842362 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":69,"threads_started":1}
I20260808 21:04:01.991024 6106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:01.990776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:36067)
0808 21:04:01.990923 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:01.990974 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":71,"threads_started":1}
I20260808 21:04:02.813123 6108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:02.812855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:41021)
0808 21:04:02.813028 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:02.813072 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":69,"threads_started":1}
I20260808 21:04:02.843189 6110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:02.842936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:41287)
0808 21:04:02.843098 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:02.843140 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":95,"threads_started":1}
I20260808 21:04:02.968391 6115 raft_consensus.cc:482] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:04:02.968500 6115 raft_consensus.cc:504] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:04:02.968730 6115 leader_election.cc:288] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
W20260808 21:04:02.969204 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
W20260808 21:04:02.969317 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
I20260808 21:04:02.969352 5479 leader_election.cc:302] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b; no voters: 792da70b7d6d411ca48defbe6be933e3, db583c4df6f1494e8d381fe66d5801b2
I20260808 21:04:02.969446 6115 raft_consensus.cc:2726] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:04:02.991905 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:02.991597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:56131)
0808 21:04:02.991783 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:02.991840 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":91,"threads_started":1}
I20260808 21:04:03.813889 6118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:03.813633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:39303)
0808 21:04:03.813792 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:03.813838 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":74,"threads_started":1}
I20260808 21:04:03.844022 6119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:03.843732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:42433)
0808 21:04:03.843928 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:03.843974 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":66,"threads_started":1}
I20260808 21:04:03.992678 6120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:03.992444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:59449)
0808 21:04:03.992588 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:03.992627 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260808 21:04:04.814750 6121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:04.814448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:46399)
0808 21:04:04.814661 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:04.814703 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":116,"threads_started":1}
I20260808 21:04:04.844950 6122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:04.844660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:49347)
0808 21:04:04.844814 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:04.844884 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260808 21:04:04.993440 6126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:04.993183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:39049)
0808 21:04:04.993353 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:04.993391 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":88,"threads_started":1}
I20260808 21:04:05.815497 6127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:05.815290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:42093)
0808 21:04:05.815413 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:05.815449 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260808 21:04:05.845669 6128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:05.845426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:45255)
0808 21:04:05.845590 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:05.845626 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260808 21:04:05.994282 6129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:05.994007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:56063)
0808 21:04:05.994189 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:05.994232 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":86,"threads_started":1}
I20260808 21:04:06.816253 6130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:06.815983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:50053)
0808 21:04:06.816149 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:06.816192 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":64,"threads_started":1}
I20260808 21:04:06.846539 6131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:06.846294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:46457)
0808 21:04:06.846432 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:06.846474 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260808 21:04:06.995056 6134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:06.994799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:51133)
0808 21:04:06.994956 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:06.995008 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":75,"threads_started":1}
I20260808 21:04:07.816982 6136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:07.816739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:43501)
0808 21:04:07.816888 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:07.816934 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":64,"threads_started":1}
I20260808 21:04:07.847200 6137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:07.847003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:39291)
0808 21:04:07.847120 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:07.847156 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260808 21:04:07.995751 6139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:07.995552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:49693)
0808 21:04:07.995669 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:07.995710 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260808 21:04:08.817724 6140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:08.817485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:39859)
0808 21:04:08.817639 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:08.817674 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":94,"threads_started":1}
I20260808 21:04:08.847971 6142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:08.847689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:39857)
0808 21:04:08.847876 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:08.847926 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":135,"threads_started":1}
I20260808 21:04:08.970338 6143 raft_consensus.cc:482] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:04:08.970438 6143 raft_consensus.cc:504] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db583c4df6f1494e8d381fe66d5801b2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 34799 } } peers { permanent_uuid: "792da70b7d6d411ca48defbe6be933e3" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 36473 } } peers { permanent_uuid: "1a7baa0210a24dd296f44f2c11e3879b" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45809 } }
I20260808 21:04:08.970607 6143 leader_election.cc:288] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799), 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473)
W20260808 21:04:08.971135 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer db583c4df6f1494e8d381fe66d5801b2 (127.14.146.194:34799): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
W20260808 21:04:08.971200 5479 leader_election.cc:341] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 792da70b7d6d411ca48defbe6be933e3 (127.14.146.195:36473): Not found: Tablet not found: ceb0f6a0bd6a4f55bc60a79e034fb144
I20260808 21:04:08.971220 5479 leader_election.cc:302] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a7baa0210a24dd296f44f2c11e3879b; no voters: 792da70b7d6d411ca48defbe6be933e3, db583c4df6f1494e8d381fe66d5801b2
I20260808 21:04:08.971292 6143 raft_consensus.cc:2726] T ceb0f6a0bd6a4f55bc60a79e034fb144 P 1a7baa0210a24dd296f44f2c11e3879b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:04:08.996446 6144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:08.996187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:57297)
0808 21:04:08.996344 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:08.996387 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":77,"threads_started":1}
I20260808 21:04:09.818521 6147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:09.818276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.193:60327)
0808 21:04:09.818436 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:09.818474 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":72,"threads_started":1}
I20260808 21:04:09.848788 6149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:09.848588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.194:42817)
0808 21:04:09.848706 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:09.848745 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260808 21:04:09.993901 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 5407
I20260808 21:04:10.000284 6157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:09.999446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:39815 (local address 127.14.146.195:56491)
0808 21:04:10.000193 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:10.000226 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:39815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":682,"threads_started":1}
I20260808 21:04:10.011633 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 5665
I20260808 21:04:10.022349 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 5863
2026-08-08T21:04:10Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18543 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:04:10 dist-test-slave-t3q3 krb5kdc[6161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:04:10 dist-test-slave-t3q3 krb5kdc[6161](info): set up 2 sockets
Aug 08 21:04:10 dist-test-slave-t3q3 krb5kdc[6161](info): commencing operation
krb5kdc: starting...
W20260808 21:04:11.289788 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:04:11 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:04:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:04:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:04:11.414130 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43373
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:43373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:04:11.499770 6177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:11.499975 6177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:11.500005 6177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:11.501186 6177 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 21:04:11.501230 6177 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 21:04:11.501243 6177 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 21:04:11.501255 6177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:04:11.501267 6177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:11.501281 6177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:11.501293 6177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:04:11.501304 6177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:04:11.502767 6177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:43373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:11.502978 6177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:11.503167 6177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:11.508597 6187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:11.508661 6177 server_base.cc:1034] running on GCE node
W20260808 21:04:11.508617 6192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:11.508612 6190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:11.509152 6177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:11.509508 6177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:11.510676 6177 hybrid_clock.cc:648] HybridClock initialized: now 1786223051510665 us; error 36 us; skew 500 ppm
Aug 08 21:04:11 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223051, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:11.513420 6177 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:04:11.513870 6177 webserver.cc:460] Webserver started at http://127.14.146.254:42025/ using document root <none> and password file <none>
I20260808 21:04:11.514117 6177 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:11.514164 6177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:11.514346 6177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:04:11.515416 6177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "87f20afcbbea4ca892da2f53c1812354"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "e3c424e8c2bef44f475bcf1146acf2cc"
server_key_iv: "a21456acde9833f768a2720e0f8ee70e"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.515785 6177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "87f20afcbbea4ca892da2f53c1812354"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "e3c424e8c2bef44f475bcf1146acf2cc"
server_key_iv: "a21456acde9833f768a2720e0f8ee70e"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.517295 6177 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:04:11.518076 6203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:11.518262 6177 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:04:11.518369 6177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "87f20afcbbea4ca892da2f53c1812354"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "e3c424e8c2bef44f475bcf1146acf2cc"
server_key_iv: "a21456acde9833f768a2720e0f8ee70e"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.518450 6177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:11.533506 6177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:11.535333 6177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:11.535498 6177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:11.539500 6177 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:43373
I20260808 21:04:11.539541 6287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:43373 every 8 connection(s)
I20260808 21:04:11.539979 6177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:04:11.540947 6288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:04:11.543246 6288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Bootstrap starting.
I20260808 21:04:11.543850 6288 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Neither blocks nor log segments found. Creating new log.
I20260808 21:04:11.544237 6288 log.cc:824] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:11.544919 6288 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: No bootstrap required, opened a new log
I20260808 21:04:11.546502 6288 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:11.546640 6288 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:04:11.546689 6288 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87f20afcbbea4ca892da2f53c1812354, State: Initialized, Role: FOLLOWER
I20260808 21:04:11.546842 6288 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:11.546934 6288 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:04:11.546989 6288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:04:11.547039 6288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:04:11.547618 6288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:11.547739 6288 leader_election.cc:302] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87f20afcbbea4ca892da2f53c1812354; no voters:
I20260808 21:04:11.547927 6288 leader_election.cc:288] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:04:11.547947 6295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:04:11.548163 6295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 1 LEADER]: Becoming Leader. State: Replica: 87f20afcbbea4ca892da2f53c1812354, State: Running, Role: LEADER
I20260808 21:04:11.548246 6288 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:04:11.548302 6295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:11.549005 6296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87f20afcbbea4ca892da2f53c1812354" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } } }
I20260808 21:04:11.549093 6296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: This master's current role is: LEADER
I20260808 21:04:11.549329 6307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:04:11.549429 6297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f20afcbbea4ca892da2f53c1812354. Latest consensus state: current_term: 1 leader_uuid: "87f20afcbbea4ca892da2f53c1812354" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } } }
I20260808 21:04:11.549508 6297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: This master's current role is: LEADER
I20260808 21:04:11.549896 6307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:04:11.550158 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 6177
I20260808 21:04:11.550261 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:04:11.550467 14923 external_mini_cluster.cc:1428] Setting key c9ee0ec2e894de656d71e53b6c86d8e6
I20260808 21:04:11.555730 6307 catalog_manager.cc:1347] Generated new cluster ID: 57869c62e30b434ca5cf16baab6ab80a
I20260808 21:04:11.555796 6307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:04:11 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223051, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:04:11.561304 6322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:11.551210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38142 (local address 127.14.146.254:43373)
0808 21:04:11.551376 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:11.551384 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:11.551410 (+ 26us) server_negotiation.cc:407] Connection header received
0808 21:04:11.551500 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:11.551506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:11.551546 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:11.551687 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:11.552447 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.553393 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.554170 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.554603 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.554745 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:11.557604 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:11.557609 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:11.557609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:11.557621 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:11.559591 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:11.560009 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:11.560012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:11.560012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:11.560157 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:11.560374 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:11.560374 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:11.560375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:11.560663 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:11.560785 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:11.560925 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 21:04:11.561056 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":70,"threads_started":1}
I20260808 21:04:11.567852 6307 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:04:11.568579 6307 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:04:11.571153 6307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Generated new TSK 0
I20260808 21:04:11.571321 6307 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:04:11.599969 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43373
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:04:11.683635 6325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:11.683857 6325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:11.683882 6325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:11.685161 6325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:11.685206 6325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:11.685235 6325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:04:11.686700 6325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:11.686942 6325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:11.687167 6325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:11.692288 6331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:11.692325 6335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:11.692467 6325 server_base.cc:1034] running on GCE node
W20260808 21:04:11.692376 6333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:11.692770 6325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:11.693070 6325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:11.694226 6325 hybrid_clock.cc:648] HybridClock initialized: now 1786223051694215 us; error 29 us; skew 500 ppm
Aug 08 21:04:11 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223051, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:11.696781 6325 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:04:11.697229 6325 webserver.cc:460] Webserver started at http://127.14.146.193:42875/ using document root <none> and password file <none>
I20260808 21:04:11.697479 6325 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:11.697547 6325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:11.697701 6325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:04:11.698760 6325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "50defd2da9e54d2d82e76bdd5bfd5bed"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "0fe1451686ed01686a1cb0772aae496b"
server_key_iv: "0e52893caa2dfc2cee1ab1de141fc473"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.699142 6325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "50defd2da9e54d2d82e76bdd5bfd5bed"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "0fe1451686ed01686a1cb0772aae496b"
server_key_iv: "0e52893caa2dfc2cee1ab1de141fc473"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.700560 6325 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:04:11.701258 6349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:11.701423 6325 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:04:11.701530 6325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "50defd2da9e54d2d82e76bdd5bfd5bed"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "0fe1451686ed01686a1cb0772aae496b"
server_key_iv: "0e52893caa2dfc2cee1ab1de141fc473"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.701603 6325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:11.719481 6325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:11.721617 6325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:11.721793 6325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:11.722038 6325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:11.722409 6325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:04:11.722465 6325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:11.722508 6325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:04:11.722550 6325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:11.728520 6325 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:42433
I20260808 21:04:11.728585 6545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:42433 every 8 connection(s)
I20260808 21:04:11.728960 6325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
Aug 08 21:04:11 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223051, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:04:11.735495 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 6325
I20260808 21:04:11.735598 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:04:11.735843 14923 external_mini_cluster.cc:1428] Setting key 25cb6f3cacc72b4240369a5d00846341
I20260808 21:04:11.738793 6322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:11.729757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:58981 (local address 127.14.146.254:43373)
0808 21:04:11.729830 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:11.729832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:11.730046 (+ 214us) server_negotiation.cc:407] Connection header received
0808 21:04:11.730584 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:11.730585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:11.730597 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:11.730663 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:11.731646 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.732253 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.733292 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.733516 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.733591 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:11.735780 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:11.735781 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:11.735781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:11.735788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:11.737353 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:11.737770 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:11.737772 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:11.737772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:11.737841 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:11.738104 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:11.738105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:11.738106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:11.738231 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:11.738308 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:11.738594 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 21:04:11.738691 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 21:04:11.739013 6550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:11.729731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:58981)
0808 21:04:11.729918 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:11.729960 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:11.730475 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:11.730744 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:11.730748 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:11.731344 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:04:11.731539 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:11.731545 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.732349 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.732350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:11.733179 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:11.733181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.733600 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.733601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:11.733735 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:11.734184 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:04:11.734192 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:04:11.735683 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:04:11.737442 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:11.737450 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:11.737452 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:11.737686 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:11.737918 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:11.737919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:11.737919 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:11.738036 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:11.738310 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:04:11.738318 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:04:11.738458 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 21:04:11.738570 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 21:04:11.738726 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":96,"threads_started":1}
I20260808 21:04:11.739534 6546 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43373
I20260808 21:04:11.739645 6546 heartbeater.cc:464] Registering TS with master...
I20260808 21:04:11.739847 6546 heartbeater.cc:511] Master 127.14.146.254:43373 requested a full tablet report, sending...
I20260808 21:04:11.740460 6230 ts_manager.cc:194] Registered new tserver with Master: 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433)
I20260808 21:04:11.741462 6230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:58981
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:04:11.763137 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43373
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:04:11.846765 6553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:11.846971 6553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:11.846993 6553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:11.848265 6553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:11.848307 6553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:11.848372 6553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:04:11.849932 6553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:11.850112 6553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:11.850292 6553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:11.855297 6560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:11.855322 6559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:11.855322 6562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:11.855531 6553 server_base.cc:1034] running on GCE node
I20260808 21:04:11.855720 6553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:11.855963 6553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:11.857100 6553 hybrid_clock.cc:648] HybridClock initialized: now 1786223051857096 us; error 37 us; skew 500 ppm
Aug 08 21:04:11 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223051, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:11.859596 6553 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:04:11.860123 6553 webserver.cc:460] Webserver started at http://127.14.146.194:40159/ using document root <none> and password file <none>
I20260808 21:04:11.860373 6553 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:11.860443 6553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:11.860592 6553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:04:11.861645 6553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "84510fe26db643a79a65821f3a0c22e0"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "d5493701b23afb403e10e3c965d7ff26"
server_key_iv: "a0905f5449901097b93e248e9b91cc88"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.862015 6553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "84510fe26db643a79a65821f3a0c22e0"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "d5493701b23afb403e10e3c965d7ff26"
server_key_iv: "a0905f5449901097b93e248e9b91cc88"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.863344 6553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:04:11.864053 6574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:11.864372 6553 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:04:11.864472 6553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "84510fe26db643a79a65821f3a0c22e0"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "d5493701b23afb403e10e3c965d7ff26"
server_key_iv: "a0905f5449901097b93e248e9b91cc88"
server_key_version: "encryptionkey@0"
I20260808 21:04:11.864555 6553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:11.879253 6553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:11.881767 6553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:11.881939 6553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:11.882206 6553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:11.882530 6553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:04:11.882586 6553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:11.882629 6553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:04:11.882659 6553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:11.888728 6553 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:35669
I20260808 21:04:11.888774 6754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:35669 every 8 connection(s)
I20260808 21:04:11.889096 6553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
Aug 08 21:04:11 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223051, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:04:11.898416 6322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:11.889877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:55145 (local address 127.14.146.254:43373)
0808 21:04:11.889969 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:11.889971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:11.890151 (+ 180us) server_negotiation.cc:407] Connection header received
0808 21:04:11.890690 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:11.890691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:11.890704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:11.890764 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:11.891720 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.892379 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.893431 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.893638 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.893717 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:11.895768 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:11.895769 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:11.895769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:11.895777 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:11.897009 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:11.897421 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:11.897422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:11.897422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:11.897503 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:11.897766 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:11.897767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:11.897768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:11.897887 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:11.897966 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:11.898242 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 21:04:11.898326 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 21:04:11.898593 6757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:11.889847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:55145)
0808 21:04:11.890029 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:11.890066 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:11.890576 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:11.890845 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:11.890848 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:11.891409 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:04:11.891607 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:11.891611 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.892485 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.892486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:11.893321 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:11.893324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:11.893729 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:11.893730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:11.893857 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:11.894287 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:04:11.894296 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:04:11.895634 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:04:11.897106 (+ 1472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:11.897114 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:11.897116 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:11.897340 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:11.897580 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:11.897581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:11.897581 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:11.897690 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:11.897957 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:04:11.897964 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:04:11.898103 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 21:04:11.898213 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 21:04:11.898365 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260808 21:04:11.898864 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 6553
I20260808 21:04:11.898974 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:04:11.899125 6755 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43373
I20260808 21:04:11.899202 14923 external_mini_cluster.cc:1428] Setting key ff631d2b9810d16a143ac9e34ffdd50c
I20260808 21:04:11.899235 6755 heartbeater.cc:464] Registering TS with master...
I20260808 21:04:11.899433 6755 heartbeater.cc:511] Master 127.14.146.254:43373 requested a full tablet report, sending...
I20260808 21:04:11.899917 6230 ts_manager.cc:194] Registered new tserver with Master: 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669)
I20260808 21:04:11.900344 6230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:55145
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:04:11.925271 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43373
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:04:12.007110 6762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:12.007387 6762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:12.007431 6762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:12.008598 6762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:12.008662 6762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:12.008705 6762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:04:12.010149 6762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:12.010416 6762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:12.010636 6762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:12.015588 6778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:12.015735 6776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:12.015784 6762 server_base.cc:1034] running on GCE node
W20260808 21:04:12.015751 6775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:12.016131 6762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:12.016387 6762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:12.017549 6762 hybrid_clock.cc:648] HybridClock initialized: now 1786223052017529 us; error 27 us; skew 500 ppm
Aug 08 21:04:12 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223052, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:12.020138 6762 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:04:12.020604 6762 webserver.cc:460] Webserver started at http://127.14.146.195:34333/ using document root <none> and password file <none>
I20260808 21:04:12.020835 6762 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:12.020928 6762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:12.021044 6762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:04:12.022018 6762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "ad8ff2dce61d4fd896e06746bcefc9a8"
format_stamp: "Formatted at 2026-08-08 21:04:12 on dist-test-slave-t3q3"
server_key: "148af51bca6ebe4e56882d65d3675727"
server_key_iv: "f32a2358119ad0866b191031b0aea20c"
server_key_version: "encryptionkey@0"
I20260808 21:04:12.022351 6762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "ad8ff2dce61d4fd896e06746bcefc9a8"
format_stamp: "Formatted at 2026-08-08 21:04:12 on dist-test-slave-t3q3"
server_key: "148af51bca6ebe4e56882d65d3675727"
server_key_iv: "f32a2358119ad0866b191031b0aea20c"
server_key_version: "encryptionkey@0"
I20260808 21:04:12.023592 6762 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:04:12.024287 6785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:12.024456 6762 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:04:12.024562 6762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "ad8ff2dce61d4fd896e06746bcefc9a8"
format_stamp: "Formatted at 2026-08-08 21:04:12 on dist-test-slave-t3q3"
server_key: "148af51bca6ebe4e56882d65d3675727"
server_key_iv: "f32a2358119ad0866b191031b0aea20c"
server_key_version: "encryptionkey@0"
I20260808 21:04:12.024636 6762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:12.059767 6762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:12.062354 6762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:12.062536 6762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:12.062796 6762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:12.063145 6762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:04:12.063215 6762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:12.063282 6762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:04:12.063313 6762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:12.069831 6762 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:43449
I20260808 21:04:12.069877 6957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:43449 every 8 connection(s)
I20260808 21:04:12.070223 6762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:04:12.070425 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 6762
I20260808 21:04:12.070531 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:04:12.070737 14923 external_mini_cluster.cc:1428] Setting key 3ea0df31e04494647ca2074ff94d7d0d
Aug 08 21:04:12 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223052, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:04:12.079530 6322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.071120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:51505 (local address 127.14.146.254:43373)
0808 21:04:12.071172 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:12.071174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:12.071351 (+ 177us) server_negotiation.cc:407] Connection header received
0808 21:04:12.072047 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:12.072048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:12.072058 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:12.072142 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:12.073124 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.073634 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.074592 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.074789 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.074840 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.076949 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:12.076950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:12.076951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:12.076957 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:12.078396 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:12.078738 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:12.078739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:12.078739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:12.078790 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:12.079000 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:12.079000 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:12.079000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:12.079101 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:12.079151 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:12.079400 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 21:04:12.079465 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:04:12.079725 6960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.071014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:51505)
0808 21:04:12.071208 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:12.071264 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:12.071953 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:12.072225 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:12.072229 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:12.072831 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:04:12.073048 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.073053 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.073708 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.073709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.074521 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.074522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.074862 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.074862 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.074968 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.075430 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:04:12.075439 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:04:12.076862 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:04:12.078466 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:12.078471 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:12.078473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:12.078676 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:12.078847 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:12.078848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:12.078848 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:12.078946 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:12.079156 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:04:12.079160 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:04:12.079287 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 21:04:12.079370 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 21:04:12.079490 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260808 21:04:12.080277 6958 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43373
I20260808 21:04:12.080379 6958 heartbeater.cc:464] Registering TS with master...
I20260808 21:04:12.080555 6958 heartbeater.cc:511] Master 127.14.146.254:43373 requested a full tablet report, sending...
I20260808 21:04:12.080935 6230 ts_manager.cc:194] Registered new tserver with Master: ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449)
I20260808 21:04:12.081314 6230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:51505
I20260808 21:04:12.082692 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:04:12.090755 6322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.084004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38158 (local address 127.14.146.254:43373)
0808 21:04:12.084132 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:12.084134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:12.084283 (+ 149us) server_negotiation.cc:407] Connection header received
0808 21:04:12.084313 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:12.084313 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:12.084325 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:12.084395 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:12.085191 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.085929 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.086918 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.087250 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.087314 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.088552 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:12.088553 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:12.088554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:12.088559 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:12.089746 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:12.090076 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:12.090077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:12.090078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:12.090138 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:12.090329 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:12.090330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:12.090330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:12.090470 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:12.090547 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:12.090631 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 21:04:12.090694 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260808 21:04:12.092430 6230 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:04:12.094482 6230 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:04:12.101285 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.097127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43449 (local address 127.0.0.1:41272)
0808 21:04:12.097507 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:12.097515 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:12.097548 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:12.097973 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:12.097973 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:12.097978 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:12.098032 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.098034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.098963 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.098964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.100159 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.100162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.100976 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.100977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.101067 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.101081 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 21:04:12.101155 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 21:04:12.101203 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":5,"spinlock_wait_cycles":896,"thread_start_us":108,"threads_started":1}
I20260808 21:04:12.101330 6982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.097380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41272 (local address 127.14.146.195:43449)
0808 21:04:12.097650 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:12.097655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:12.097668 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:04:12.097711 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:12.097713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:12.097731 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:12.097828 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:12.098154 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.098838 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.100244 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.100885 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.100964 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.101020 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:12.101186 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 21:04:12.101236 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":81,"threads_started":1}
I20260808 21:04:12.101521 6975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.097127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42433 (local address 127.0.0.1:36404)
0808 21:04:12.097399 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:12.097410 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:12.097453 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:12.097917 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:12.097920 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:12.097922 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:12.097995 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.097997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.099371 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.099372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.100389 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.100391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.101303 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.101304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.101390 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.101394 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:04:12.101427 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 21:04:12.101469 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":105,"threads_started":1}
I20260808 21:04:12.101814 6984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.097417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36404 (local address 127.14.146.193:42433)
0808 21:04:12.097721 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:12.097726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:12.097737 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:04:12.097779 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:12.097781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:12.097798 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:12.098077 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:12.098157 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.099256 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.100475 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.101202 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.101579 (+ 377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.101626 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:12.101670 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 21:04:12.101716 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":173,"threads_started":1}
I20260808 21:04:12.102445 6854 tablet_service.cc:1467] Processing CreateTablet for tablet f40bcb49392840e59959250d531029e5 (DEFAULT_TABLE table=test-table [id=ea728298fb60401ab4b0ab34927c4d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:04:12.102573 6978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.097092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:35669 (local address 127.0.0.1:58268)
0808 21:04:12.097290 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:12.097331 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:12.097401 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:12.097973 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:12.097973 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:12.097976 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:12.098072 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.098074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.100470 (+ 2396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.100470 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.101265 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.101268 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.102325 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.102326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.102389 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.102392 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:04:12.102450 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 21:04:12.102489 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":6,"thread_start_us":61,"threads_started":1}
I20260808 21:04:12.102607 6980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.097215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58268 (local address 127.14.146.194:35669)
0808 21:04:12.097747 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:12.097751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:12.097764 (+ 13us) server_negotiation.cc:407] Connection header received
0808 21:04:12.097800 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:12.097802 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:12.097817 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:12.097889 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:12.098138 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.099256 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.101361 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.102171 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.102241 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.102290 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:12.102484 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 21:04:12.102532 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":93,"threads_started":1}
I20260808 21:04:12.102591 6427 tablet_service.cc:1467] Processing CreateTablet for tablet f40bcb49392840e59959250d531029e5 (DEFAULT_TABLE table=test-table [id=ea728298fb60401ab4b0ab34927c4d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:04:12.102839 6854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f40bcb49392840e59959250d531029e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:04:12.102936 6427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f40bcb49392840e59959250d531029e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:04:12.103277 6652 tablet_service.cc:1467] Processing CreateTablet for tablet f40bcb49392840e59959250d531029e5 (DEFAULT_TABLE table=test-table [id=ea728298fb60401ab4b0ab34927c4d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:04:12.103574 6652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f40bcb49392840e59959250d531029e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:04:12.106297 6985 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Bootstrap starting.
I20260808 21:04:12.106554 6986 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Bootstrap starting.
I20260808 21:04:12.106915 6987 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Bootstrap starting.
I20260808 21:04:12.107651 6985 tablet_bootstrap.cc:654] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Neither blocks nor log segments found. Creating new log.
I20260808 21:04:12.107651 6987 tablet_bootstrap.cc:654] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Neither blocks nor log segments found. Creating new log.
I20260808 21:04:12.108392 6987 log.cc:824] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:12.108392 6985 log.cc:824] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:12.108548 6986 tablet_bootstrap.cc:654] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Neither blocks nor log segments found. Creating new log.
I20260808 21:04:12.109124 6986 log.cc:824] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:12.109493 6985 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: No bootstrap required, opened a new log
I20260808 21:04:12.109524 6987 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: No bootstrap required, opened a new log
I20260808 21:04:12.109578 6985 ts_tablet_manager.cc:1397] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 21:04:12.109594 6987 ts_tablet_manager.cc:1397] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 21:04:12.109939 6986 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: No bootstrap required, opened a new log
I20260808 21:04:12.110033 6986 ts_tablet_manager.cc:1397] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 21:04:12.111028 6985 raft_consensus.cc:348] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.111202 6985 raft_consensus.cc:374] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:04:12.111253 6985 raft_consensus.cc:729] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50defd2da9e54d2d82e76bdd5bfd5bed, State: Initialized, Role: FOLLOWER
I20260808 21:04:12.111388 6985 consensus_queue.cc:260] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.111672 6985 ts_tablet_manager.cc:1428] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:04:12.111675 6546 heartbeater.cc:503] Master 127.14.146.254:43373 was elected leader, sending a full tablet report...
I20260808 21:04:12.111786 6987 raft_consensus.cc:348] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.111981 6987 raft_consensus.cc:374] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:04:12.112020 6987 raft_consensus.cc:729] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84510fe26db643a79a65821f3a0c22e0, State: Initialized, Role: FOLLOWER
I20260808 21:04:12.112185 6987 consensus_queue.cc:260] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.112241 6986 raft_consensus.cc:348] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.112494 6986 raft_consensus.cc:374] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:04:12.112517 6755 heartbeater.cc:503] Master 127.14.146.254:43373 was elected leader, sending a full tablet report...
I20260808 21:04:12.112562 6986 raft_consensus.cc:729] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad8ff2dce61d4fd896e06746bcefc9a8, State: Initialized, Role: FOLLOWER
I20260808 21:04:12.112723 6986 consensus_queue.cc:260] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.112920 6987 ts_tablet_manager.cc:1428] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:04:12.113123 6986 ts_tablet_manager.cc:1428] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:04:12.113184 6958 heartbeater.cc:503] Master 127.14.146.254:43373 was elected leader, sending a full tablet report...
W20260808 21:04:12.139703 6756 tablet.cc:2369] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:04:12.229739 6548 tablet.cc:2369] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:04:12.301581 6997 raft_consensus.cc:482] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:04:12.301740 6997 raft_consensus.cc:504] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.302220 6997 leader_election.cc:288] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669), 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433)
I20260808 21:04:12.306285 6984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.302542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:52477 (local address 127.14.146.193:42433)
0808 21:04:12.302593 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:12.302595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:12.302797 (+ 202us) server_negotiation.cc:407] Connection header received
0808 21:04:12.302836 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:12.302837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:12.302848 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:12.302923 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:12.303064 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.303775 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.305335 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.305899 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.305985 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.305994 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:12.306168 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 21:04:12.306211 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 21:04:12.306285 6980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.302545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:42021 (local address 127.14.146.194:35669)
0808 21:04:12.302607 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:12.302609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:12.302620 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:04:12.302654 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:12.302656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:12.302668 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:12.302730 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:12.302955 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.303765 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.305347 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.305917 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.305986 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.305994 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:12.306173 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 21:04:12.306211 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 21:04:12.306314 6960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.302432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:35669 (local address 127.14.146.195:42021)
0808 21:04:12.302502 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:12.302514 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:12.302561 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:12.302764 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:12.302765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:12.302767 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:12.302852 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.302854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.303854 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.303855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.305234 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.305238 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.305995 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.305996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.306089 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.306091 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:04:12.306145 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 21:04:12.306202 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":105}
I20260808 21:04:12.306322 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.302496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42433 (local address 127.14.146.195:52477)
0808 21:04:12.302694 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:12.302701 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:12.302771 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:12.302915 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:12.302917 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:12.302918 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:12.302985 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.302986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.303854 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.303855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.305245 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:12.305246 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.305995 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.305996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:12.306080 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.306084 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:04:12.306145 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 21:04:12.306201 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":73,"thread_start_us":133,"threads_started":1}
I20260808 21:04:12.306707 6678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f40bcb49392840e59959250d531029e5" candidate_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84510fe26db643a79a65821f3a0c22e0" is_pre_election: true
I20260808 21:04:12.306758 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f40bcb49392840e59959250d531029e5" candidate_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" is_pre_election: true
I20260808 21:04:12.306897 6678 raft_consensus.cc:2454] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8ff2dce61d4fd896e06746bcefc9a8 in term 0.
I20260808 21:04:12.306897 6466 raft_consensus.cc:2454] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8ff2dce61d4fd896e06746bcefc9a8 in term 0.
I20260808 21:04:12.307163 6792 leader_election.cc:302] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50defd2da9e54d2d82e76bdd5bfd5bed, ad8ff2dce61d4fd896e06746bcefc9a8; no voters:
I20260808 21:04:12.307343 6997 raft_consensus.cc:2781] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:04:12.307432 6997 raft_consensus.cc:482] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:04:12.307464 6997 raft_consensus.cc:3037] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:04:12.308318 6997 raft_consensus.cc:504] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.308473 6997 leader_election.cc:288] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669), 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433)
I20260808 21:04:12.308669 6466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f40bcb49392840e59959250d531029e5" candidate_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed"
I20260808 21:04:12.308668 6678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f40bcb49392840e59959250d531029e5" candidate_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84510fe26db643a79a65821f3a0c22e0"
I20260808 21:04:12.308756 6678 raft_consensus.cc:3037] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:04:12.308756 6466 raft_consensus.cc:3037] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:04:12.309646 6678 raft_consensus.cc:2454] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8ff2dce61d4fd896e06746bcefc9a8 in term 1.
I20260808 21:04:12.309646 6466 raft_consensus.cc:2454] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8ff2dce61d4fd896e06746bcefc9a8 in term 1.
I20260808 21:04:12.309834 6788 leader_election.cc:302] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84510fe26db643a79a65821f3a0c22e0, ad8ff2dce61d4fd896e06746bcefc9a8; no voters:
I20260808 21:04:12.309968 6997 raft_consensus.cc:2781] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:04:12.310133 6997 raft_consensus.cc:686] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 LEADER]: Becoming Leader. State: Replica: ad8ff2dce61d4fd896e06746bcefc9a8, State: Running, Role: LEADER
I20260808 21:04:12.310245 6997 consensus_queue.cc:237] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:12.311132 6230 catalog_manager.cc:5495] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195). New cstate: current_term: 1 leader_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } health_report { overall_health: UNKNOWN } } }
W20260808 21:04:12.320914 6959 tablet.cc:2369] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:04:12.326383 6982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.324342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41284 (local address 127.14.146.195:43449)
0808 21:04:12.324403 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:12.324405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:12.324414 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:04:12.324448 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:12.324449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:12.324472 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:12.324532 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:04:12.324646 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.325105 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.325791 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:12.325966 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:12.326014 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:12.326136 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:04:12.326227 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:04:12.326286 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:12.326319 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 21:04:12.326336 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 21:04:12.328141 6678 raft_consensus.cc:1261] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 1 FOLLOWER]: Refusing update from remote peer ad8ff2dce61d4fd896e06746bcefc9a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:04:12.328191 6466 raft_consensus.cc:1261] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Refusing update from remote peer ad8ff2dce61d4fd896e06746bcefc9a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:04:12.328500 6997 consensus_queue.cc:1035] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:04:12.328634 7001 consensus_queue.cc:1035] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:04:12.330616 7011 mvcc.cc:205] Tried to move back new op lower bound from 7316369622333251584 to 7316369622263451648. Current Snapshot: MvccSnapshot[applied={T|T < 7316369622333251584}]
I20260808 21:04:12.333593 6228 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:04:12.333695 6228 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:04:12.334491 6228 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Sending DeleteTablet for 3 replicas of tablet f40bcb49392840e59959250d531029e5
I20260808 21:04:12.334839 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 6325
I20260808 21:04:12.334827 6652 tablet_service.cc:1514] Processing DeleteTablet for tablet f40bcb49392840e59959250d531029e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:04:12 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:58268
I20260808 21:04:12.334837 6427 tablet_service.cc:1514] Processing DeleteTablet for tablet f40bcb49392840e59959250d531029e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:04:12 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:36404
I20260808 21:04:12.346652 6854 tablet_service.cc:1514] Processing DeleteTablet for tablet f40bcb49392840e59959250d531029e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:04:12 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:41272
I20260808 21:04:12.347487 7029 tablet_replica.cc:330] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: stopping tablet replica
I20260808 21:04:12.347599 7029 raft_consensus.cc:2229] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:04:12.347779 7029 raft_consensus.cc:2258] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:04:12.350381 7029 ts_tablet_manager.cc:1905] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:04:12.352569 7028 tablet_replica.cc:330] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: stopping tablet replica
I20260808 21:04:12.352571 7029 ts_tablet_manager.cc:1918] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:04:12.352686 7029 log.cc:1196] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/f40bcb49392840e59959250d531029e5
I20260808 21:04:12.352720 7028 raft_consensus.cc:2229] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:04:12.352861 7028 raft_consensus.cc:2258] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:04:12.353057 7029 ts_tablet_manager.cc:1939] T f40bcb49392840e59959250d531029e5 P ad8ff2dce61d4fd896e06746bcefc9a8: Deleting consensus metadata
I20260808 21:04:12.353578 6204 catalog_manager.cc:4841] TS ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449): tablet f40bcb49392840e59959250d531029e5 (table test-table [id=ea728298fb60401ab4b0ab34927c4d28]) successfully deleted
I20260808 21:04:12.354197 7028 ts_tablet_manager.cc:1905] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:04:12.355489 7028 ts_tablet_manager.cc:1918] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:04:12.355590 7028 log.cc:1196] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/f40bcb49392840e59959250d531029e5
I20260808 21:04:12.355980 7028 ts_tablet_manager.cc:1939] T f40bcb49392840e59959250d531029e5 P 84510fe26db643a79a65821f3a0c22e0: Deleting consensus metadata
I20260808 21:04:12.356580 6207 catalog_manager.cc:4841] TS 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669): tablet f40bcb49392840e59959250d531029e5 (table test-table [id=ea728298fb60401ab4b0ab34927c4d28]) successfully deleted
W20260808 21:04:12.371960 6210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:42433 (error 108)
I20260808 21:04:12.372231 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 6553
I20260808 21:04:12.374503 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:12.374337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42433 (local address 127.0.0.1:36412)
0808 21:04:12.374402 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:12.374453 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:42433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 21:04:12.374807 6210 catalog_manager.cc:4584] TS 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f40bcb49392840e59959250d531029e5: Network error: Client connection negotiation failed: client connection to 127.14.146.193:42433: connect: Connection refused (error 111)
I20260808 21:04:12.382860 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 6762
I20260808 21:04:12.394039 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 6177
I20260808 21:04:32.403723 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43373
--webserver_interface=127.14.146.254
--webserver_port=42025
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:43373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:04:32.488392 7032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:32.488623 7032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:32.488667 7032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:32.489777 7032 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 21:04:32.489835 7032 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 21:04:32.489859 7032 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 21:04:32.489878 7032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:04:32.489908 7032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:32.489933 7032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:32.489964 7032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:04:32.489995 7032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:04:32.491482 7032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:43373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=42025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:32.491752 7032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:32.491971 7032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:32.501065 7044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:32.501319 7032 server_base.cc:1034] running on GCE node
W20260808 21:04:32.501065 7041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:32.501091 7038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:32.501835 7032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:32.502153 7032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:32.503321 7032 hybrid_clock.cc:648] HybridClock initialized: now 1786223072503307 us; error 42 us; skew 500 ppm
Aug 08 21:04:32 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223072, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:32.506091 7032 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:04:32.506539 7032 webserver.cc:460] Webserver started at http://127.14.146.254:42025/ using document root <none> and password file <none>
I20260808 21:04:32.506793 7032 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:32.506867 7032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:32.508293 7032 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:32.508949 7057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.509126 7032 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:04:32.509214 7032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "87f20afcbbea4ca892da2f53c1812354"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "e3c424e8c2bef44f475bcf1146acf2cc"
server_key_iv: "a21456acde9833f768a2720e0f8ee70e"
server_key_version: "encryptionkey@0"
I20260808 21:04:32.509594 7032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:32.522272 7032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:32.524219 7032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:32.524333 7032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:32.528224 7032 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:43373
I20260808 21:04:32.528299 7133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:43373 every 8 connection(s)
I20260808 21:04:32.528656 7032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:04:32.530138 7134 sys_catalog.cc:263] Verifying existing consensus state
I20260808 21:04:32.530665 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 7032
I20260808 21:04:32.530977 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:42433
--local_ip_for_outbound_sockets=127.14.146.193
--tserver_master_addrs=127.14.146.254:43373
--webserver_port=42875
--webserver_interface=127.14.146.193
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:04:32.531021 7134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Bootstrap starting.
I20260808 21:04:32.540134 7134 log.cc:824] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:32.541971 7134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:04:32.542295 7134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Bootstrap complete.
I20260808 21:04:32.544656 7134 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:32.544876 7134 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87f20afcbbea4ca892da2f53c1812354, State: Initialized, Role: FOLLOWER
I20260808 21:04:32.545073 7134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:32.545150 7134 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:04:32.545214 7134 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:04:32.545307 7134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 1 FOLLOWER]: Advancing to term 2
I20260808 21:04:32.546334 7134 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:32.546453 7134 leader_election.cc:302] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87f20afcbbea4ca892da2f53c1812354; no voters:
I20260808 21:04:32.546646 7134 leader_election.cc:288] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 21:04:32.546681 7139 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 21:04:32.546808 7139 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 2 LEADER]: Becoming Leader. State: Replica: 87f20afcbbea4ca892da2f53c1812354, State: Running, Role: LEADER
I20260808 21:04:32.546928 7134 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:04:32.546957 7139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:32.547338 7141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "87f20afcbbea4ca892da2f53c1812354" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } } }
I20260808 21:04:32.547426 7141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: This master's current role is: LEADER
I20260808 21:04:32.547658 7142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f20afcbbea4ca892da2f53c1812354. Latest consensus state: current_term: 2 leader_uuid: "87f20afcbbea4ca892da2f53c1812354" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } } }
I20260808 21:04:32.547744 7142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: This master's current role is: LEADER
I20260808 21:04:32.547843 7146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:04:32.548679 7146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:04:32.548792 7146 catalog_manager.cc:1259] Loaded cluster ID: 57869c62e30b434ca5cf16baab6ab80a
I20260808 21:04:32.548893 7146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:04:32.550371 7146 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:04:32.550555 7146 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Loaded TSK: 0
I20260808 21:04:32.560310 7146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Generated new TSK 1
I20260808 21:04:32.560405 7146 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 21:04:32.619428 7136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:32.619645 7136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:32.619670 7136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:32.620878 7136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:32.620924 7136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:32.620950 7136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:04:32.622591 7136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:42433
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=42875
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:32.622849 7136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:32.623090 7136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:32.628170 7181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:32.628207 7174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:32.628435 7136 server_base.cc:1034] running on GCE node
W20260808 21:04:32.628535 7176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:32.628756 7136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:32.629037 7136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:32.630224 7136 hybrid_clock.cc:648] HybridClock initialized: now 1786223072630200 us; error 42 us; skew 500 ppm
Aug 08 21:04:32 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223072, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:32.633307 7136 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:04:32.633802 7136 webserver.cc:460] Webserver started at http://127.14.146.193:42875/ using document root <none> and password file <none>
I20260808 21:04:32.634038 7136 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:32.634123 7136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:32.635483 7136 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:32.636227 7190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.636407 7136 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:32.636504 7136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "50defd2da9e54d2d82e76bdd5bfd5bed"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "0fe1451686ed01686a1cb0772aae496b"
server_key_iv: "0e52893caa2dfc2cee1ab1de141fc473"
server_key_version: "encryptionkey@0"
I20260808 21:04:32.636883 7136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:32.658012 7136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:32.660436 7136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:32.660595 7136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:32.660838 7136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:32.661335 7200 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 21:04:32.663332 7136 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 21:04:32.663409 7136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 21:04:32.663468 7136 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 21:04:32.664243 7136 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 21:04:32.664294 7136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:32.664364 7200 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Bootstrap starting.
I20260808 21:04:32.671139 7136 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:42433
I20260808 21:04:32.671209 7380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:42433 every 8 connection(s)
I20260808 21:04:32.671669 7136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:04:32.676195 7200 log.cc:824] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:32.677294 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 7136
I20260808 21:04:32.677608 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:35669
--local_ip_for_outbound_sockets=127.14.146.194
--tserver_master_addrs=127.14.146.254:43373
--webserver_port=40159
--webserver_interface=127.14.146.194
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:04:32.679207 7200 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
Aug 08 21:04:32 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223072, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:04:32.679550 7200 tablet_bootstrap.cc:492] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Bootstrap complete.
I20260808 21:04:32.680822 7200 ts_tablet_manager.cc:1397] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.012s
I20260808 21:04:32.682314 7200 raft_consensus.cc:348] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.682710 7200 raft_consensus.cc:729] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50defd2da9e54d2d82e76bdd5bfd5bed, State: Initialized, Role: FOLLOWER
I20260808 21:04:32.682883 7200 consensus_queue.cc:260] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.683216 7200 ts_tablet_manager.cc:1428] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:04:32.684353 7383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.672479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:52941)
0808 21:04:32.672718 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:32.672773 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:32.673348 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:32.673809 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:32.673814 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:32.674109 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:04:32.674304 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.674310 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.675476 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.675477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.676456 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.676460 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.677338 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.677340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.677492 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.678112 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:04:32.678122 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:04:32.679915 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:04:32.682246 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:32.682252 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:32.682254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:32.682543 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:32.683052 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:32.683053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:32.683053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:32.683198 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:32.683640 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:04:32.683647 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:04:32.683793 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 21:04:32.683918 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 21:04:32.684143 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":126,"threads_started":1}
I20260808 21:04:32.684551 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.672579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:52941 (local address 127.14.146.254:43373)
0808 21:04:32.672963 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.672972 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.673030 (+ 58us) server_negotiation.cc:407] Connection header received
0808 21:04:32.673582 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.673587 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.673635 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.673774 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:32.674431 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.675316 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.676547 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.677120 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.677230 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.680032 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:32.680036 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:32.680036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:32.680050 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:32.682139 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:32.682646 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:32.682649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:32.682650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:32.682802 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:32.683286 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:32.683287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:32.683288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:32.683548 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:32.683660 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.684205 (+ 545us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.684342 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":109,"threads_started":1}
I20260808 21:04:32.685246 7381 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43373
I20260808 21:04:32.685338 7381 heartbeater.cc:464] Registering TS with master...
I20260808 21:04:32.685491 7381 heartbeater.cc:511] Master 127.14.146.254:43373 requested a full tablet report, sending...
I20260808 21:04:32.686165 7077 ts_manager.cc:194] Registered new tserver with Master: 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433)
I20260808 21:04:32.687266 7077 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:52941
I20260808 21:04:32.688166 7381 heartbeater.cc:503] Master 127.14.146.254:43373 was elected leader, sending a full tablet report...
I20260808 21:04:32.693070 7392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.686748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42433 (local address 127.0.0.1:55958)
0808 21:04:32.689244 (+ 2496us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:32.689288 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:32.689365 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:32.689680 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:32.689683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:32.689684 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:32.689737 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.689738 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.691027 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.691027 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.691807 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.691809 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.692828 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.692829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.692892 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.692904 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 21:04:32.692961 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 21:04:32.693016 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2463,"thread_start_us":90,"threads_started":1}
I20260808 21:04:32.693101 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.686987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55958 (local address 127.14.146.193:42433)
0808 21:04:32.689506 (+ 2519us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.689511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.689522 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:04:32.689560 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.689562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.689580 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.689674 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:32.689798 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.690940 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.691914 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.692745 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.692831 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.692882 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.692975 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.693030 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2483,"thread_start_us":75,"threads_started":1}
I20260808 21:04:32.693497 7273 tablet_service.cc:1514] Processing DeleteTablet for tablet f40bcb49392840e59959250d531029e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:04:12 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:55958
I20260808 21:04:32.694000 7395 tablet_replica.cc:330] stopping tablet replica
I20260808 21:04:32.694118 7395 raft_consensus.cc:2229] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:04:32.694186 7395 raft_consensus.cc:2258] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:04:32.694512 7395 ts_tablet_manager.cc:1905] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:04:32.696934 7395 ts_tablet_manager.cc:1918] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:04:32.697026 7395 log.cc:1196] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal/wals/f40bcb49392840e59959250d531029e5
I20260808 21:04:32.697273 7395 ts_tablet_manager.cc:1939] T f40bcb49392840e59959250d531029e5 P 50defd2da9e54d2d82e76bdd5bfd5bed: Deleting consensus metadata
I20260808 21:04:32.697801 7061 catalog_manager.cc:4841] TS 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433): tablet f40bcb49392840e59959250d531029e5 (table test-table [id=ea728298fb60401ab4b0ab34927c4d28]) successfully deleted
W20260808 21:04:32.770979 7389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:32.771234 7389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:32.771276 7389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:32.772527 7389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:32.772589 7389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:32.772635 7389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:04:32.774145 7389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:35669
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=40159
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:32.774416 7389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:32.774662 7389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:32.780025 7404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:32.780033 7408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:32.780140 7402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:32.780097 7389 server_base.cc:1034] running on GCE node
I20260808 21:04:32.780468 7389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:32.780726 7389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:32.781919 7389 hybrid_clock.cc:648] HybridClock initialized: now 1786223072781899 us; error 48 us; skew 500 ppm
Aug 08 21:04:32 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223072, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:32.784664 7389 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:04:32.785127 7389 webserver.cc:460] Webserver started at http://127.14.146.194:40159/ using document root <none> and password file <none>
I20260808 21:04:32.785384 7389 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:32.785475 7389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:32.786971 7389 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 21:04:32.787637 7419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.787833 7389 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:32.787932 7389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "84510fe26db643a79a65821f3a0c22e0"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "d5493701b23afb403e10e3c965d7ff26"
server_key_iv: "a0905f5449901097b93e248e9b91cc88"
server_key_version: "encryptionkey@0"
I20260808 21:04:32.788349 7389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:32.806064 7389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:32.808334 7389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:32.808506 7389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:32.808761 7389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:32.809082 7389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:04:32.809134 7389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.809176 7389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:04:32.809201 7389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.815321 7389 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:35669
I20260808 21:04:32.815403 7593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:35669 every 8 connection(s)
I20260808 21:04:32.815775 7389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:04:32.816277 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 7389
I20260808 21:04:32.816618 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:43449
--local_ip_for_outbound_sockets=127.14.146.195
--tserver_master_addrs=127.14.146.254:43373
--webserver_port=34333
--webserver_interface=127.14.146.195
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 21:04:32 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223072, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:04:32.827941 7596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.816686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:60555)
0808 21:04:32.816863 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:32.816901 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:32.817363 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:32.818562 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:32.818568 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:32.819191 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:04:32.819394 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.819400 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.820464 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.820465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.821514 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.821523 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.822100 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.822102 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.822221 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.822799 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:04:32.822809 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:04:32.824257 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:04:32.826493 (+ 2236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:32.826499 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:32.826501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:32.826738 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:32.827002 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:32.827002 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:32.827003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:32.827107 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:32.827426 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:04:32.827430 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:04:32.827547 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 21:04:32.827647 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 21:04:32.827774 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260808 21:04:32.827947 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.816651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:60555 (local address 127.14.146.254:43373)
0808 21:04:32.818310 (+ 1659us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.818312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.818322 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:04:32.818347 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.818348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.818362 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.818450 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:32.819511 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.820339 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.821616 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.821998 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.822091 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.824362 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:32.824364 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:32.824365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:32.824374 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:32.826403 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:32.826837 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:32.826839 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:32.826840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:32.826915 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:32.827176 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:32.827177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:32.827178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:32.827352 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:32.827440 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.827699 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.827810 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1627}
I20260808 21:04:32.828613 7594 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43373
I20260808 21:04:32.828718 7594 heartbeater.cc:464] Registering TS with master...
I20260808 21:04:32.828928 7594 heartbeater.cc:511] Master 127.14.146.254:43373 requested a full tablet report, sending...
I20260808 21:04:32.829362 7077 ts_manager.cc:194] Registered new tserver with Master: 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669)
I20260808 21:04:32.829720 7077 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:60555
W20260808 21:04:32.904738 7597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:32.904979 7597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:32.905028 7597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:32.906180 7597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:32.906244 7597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:32.906291 7597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:04:32.907793 7597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:43449
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=34333
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:32.908053 7597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:32.908327 7597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:32.913767 7614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:32.913776 7612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:32.913784 7608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:32.914017 7597 server_base.cc:1034] running on GCE node
I20260808 21:04:32.914206 7597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:32.914393 7597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:32.915529 7597 hybrid_clock.cc:648] HybridClock initialized: now 1786223072915510 us; error 33 us; skew 500 ppm
Aug 08 21:04:32 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223072, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:32.918143 7597 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:04:32.918623 7597 webserver.cc:460] Webserver started at http://127.14.146.195:34333/ using document root <none> and password file <none>
I20260808 21:04:32.918849 7597 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:32.918929 7597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:32.920336 7597 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:32.920950 7624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.921255 7597 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:32.921350 7597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "ad8ff2dce61d4fd896e06746bcefc9a8"
format_stamp: "Formatted at 2026-08-08 21:04:12 on dist-test-slave-t3q3"
server_key: "148af51bca6ebe4e56882d65d3675727"
server_key_iv: "f32a2358119ad0866b191031b0aea20c"
server_key_version: "encryptionkey@0"
I20260808 21:04:32.921677 7597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:32.933385 7597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:32.935560 7597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:32.935671 7597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:32.935844 7597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:32.936208 7597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:04:32.936246 7597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.936282 7597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:04:32.936309 7597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.942101 7597 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:43449
I20260808 21:04:32.942174 7819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:43449 every 8 connection(s)
I20260808 21:04:32.942514 7597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:04:32.943420 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 7597
Aug 08 21:04:32 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223072, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:04:32.951730 7824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.943864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48308 (local address 127.14.146.254:43373)
0808 21:04:32.943999 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.944001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.944123 (+ 122us) server_negotiation.cc:407] Connection header received
0808 21:04:32.944212 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.944213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.944227 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.944321 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:32.944905 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.945787 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.946883 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.947266 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.947352 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.948788 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:32.948790 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:32.948790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:32.948799 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:32.950304 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:32.950684 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:32.950685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:32.950685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:32.950748 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:32.950965 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:32.950966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:32.950966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:32.951144 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:32.951305 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.951457 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.951590 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260808 21:04:32.954020 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.943317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:58187 (local address 127.14.146.254:43373)
0808 21:04:32.943392 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.943395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.943657 (+ 262us) server_negotiation.cc:407] Connection header received
0808 21:04:32.944440 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.944441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.944450 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.944495 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:32.945794 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.946606 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.948001 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.948386 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.948469 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.950916 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:32.950917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:32.950917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:32.950923 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:32.952819 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:32.953251 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:32.953251 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:32.953252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:32.953307 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:32.953498 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:32.953498 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:32.953499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:32.953595 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:32.953651 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.953894 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.953959 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 21:04:32.954267 7822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.943286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:58187)
0808 21:04:32.943478 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:32.943538 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:32.944345 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:32.944574 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:32.944579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:32.945393 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:04:32.945687 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.945694 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.946721 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.946723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.947917 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.947920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.948475 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.948476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.948596 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.949062 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:04:32.949073 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:04:32.950836 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:04:32.952915 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:32.952921 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:32.952922 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:32.953181 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:32.953360 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:32.953361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:32.953361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:32.953448 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:32.953652 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:04:32.953657 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:04:32.953769 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 21:04:32.953868 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 21:04:32.953986 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
I20260808 21:04:32.954690 7820 heartbeater.cc:347] Connected to a master server at 127.14.146.254:43373
I20260808 21:04:32.954803 7820 heartbeater.cc:464] Registering TS with master...
I20260808 21:04:32.954998 7820 heartbeater.cc:511] Master 127.14.146.254:43373 requested a full tablet report, sending...
I20260808 21:04:32.955392 7077 ts_manager.cc:194] Registered new tserver with Master: ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449)
I20260808 21:04:32.955798 7077 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:58187
I20260808 21:04:32.963579 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:04:32.966451 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.963960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48318 (local address 127.14.146.254:43373)
0808 21:04:32.964028 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.964030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.964217 (+ 187us) server_negotiation.cc:407] Connection header received
0808 21:04:32.964272 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.964273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.964310 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.964378 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:04:32.964461 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.964967 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.965720 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.965917 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.965974 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.966137 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:04:32.966238 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:04:32.966314 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.966332 (+ 18us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.966348 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:04:32.966792 7077 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:48318:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:04:32.968510 7077 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:04:32.970752 7273 tablet_service.cc:1467] Processing CreateTablet for tablet 83b25dd428d049edbe6c9dba8ecf6be7 (DEFAULT_TABLE table=test-table [id=fbedcea3b8034bdba1c97d0e038c0fc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:04:32.970974 7273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83b25dd428d049edbe6c9dba8ecf6be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:04:32.972683 7200 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Bootstrap starting.
I20260808 21:04:32.973061 7200 tablet_bootstrap.cc:654] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Neither blocks nor log segments found. Creating new log.
I20260808 21:04:32.973692 7200 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: No bootstrap required, opened a new log
I20260808 21:04:32.973750 7200 ts_tablet_manager.cc:1397] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 21:04:32.973865 7200 raft_consensus.cc:348] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.973941 7200 raft_consensus.cc:374] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:04:32.973986 7200 raft_consensus.cc:729] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50defd2da9e54d2d82e76bdd5bfd5bed, State: Initialized, Role: FOLLOWER
I20260808 21:04:32.974035 7200 consensus_queue.cc:260] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.974119 7200 ts_tablet_manager.cc:1428] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:32.974763 7392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.970356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:35669 (local address 127.0.0.1:58934)
0808 21:04:32.970473 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:32.970485 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:32.970539 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:32.970906 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:32.970907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:32.970909 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:32.970955 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.970956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.972417 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.972417 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.973590 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.973593 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.974524 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.974525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.974592 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.974597 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:04:32.974651 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 21:04:32.974701 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":66}
I20260808 21:04:32.975003 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.970356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43449 (local address 127.0.0.1:36560)
0808 21:04:32.971033 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:32.971059 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:32.971118 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:32.971329 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:32.971330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:32.971332 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:32.971377 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.971379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.972368 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.972369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.973858 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.973861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.974770 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.974771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.974835 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.974839 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:04:32.974884 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 21:04:32.974932 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":57,"thread_start_us":122,"threads_started":1}
I20260808 21:04:32.975029 7832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.970521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58934 (local address 127.14.146.194:35669)
0808 21:04:32.970717 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.970721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.970731 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:04:32.970772 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.970773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.970786 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.970889 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:32.971066 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.972291 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.973674 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.974431 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.974523 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.974587 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.974895 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.974937 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":78,"threads_started":1}
I20260808 21:04:32.975057 7830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.970450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36560 (local address 127.14.146.195:43449)
0808 21:04:32.970652 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.970657 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.971185 (+ 528us) server_negotiation.cc:407] Connection header received
0808 21:04:32.971235 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.971237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.971254 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.971331 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:32.971535 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.972282 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.973922 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.974685 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.974772 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.974826 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.974934 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.974972 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":113,"threads_started":1}
I20260808 21:04:32.975800 7496 tablet_service.cc:1467] Processing CreateTablet for tablet 83b25dd428d049edbe6c9dba8ecf6be7 (DEFAULT_TABLE table=test-table [id=fbedcea3b8034bdba1c97d0e038c0fc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:04:32.975867 7708 tablet_service.cc:1467] Processing CreateTablet for tablet 83b25dd428d049edbe6c9dba8ecf6be7 (DEFAULT_TABLE table=test-table [id=fbedcea3b8034bdba1c97d0e038c0fc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:04:32.976208 7496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83b25dd428d049edbe6c9dba8ecf6be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:04:32.976227 7708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83b25dd428d049edbe6c9dba8ecf6be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:04:32.979776 7834 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: Bootstrap starting.
I20260808 21:04:32.980198 7837 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: Bootstrap starting.
I20260808 21:04:32.980448 7834 tablet_bootstrap.cc:654] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: Neither blocks nor log segments found. Creating new log.
I20260808 21:04:32.980783 7837 tablet_bootstrap.cc:654] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: Neither blocks nor log segments found. Creating new log.
I20260808 21:04:32.980885 7834 log.cc:824] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:32.981382 7837 log.cc:824] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:32.981606 7834 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: No bootstrap required, opened a new log
I20260808 21:04:32.981688 7834 ts_tablet_manager.cc:1397] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 21:04:32.982116 7837 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: No bootstrap required, opened a new log
I20260808 21:04:32.982170 7837 ts_tablet_manager.cc:1397] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:04:32.983435 7834 raft_consensus.cc:348] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.983598 7834 raft_consensus.cc:374] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:04:32.983677 7834 raft_consensus.cc:729] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad8ff2dce61d4fd896e06746bcefc9a8, State: Initialized, Role: FOLLOWER
I20260808 21:04:32.983688 7837 raft_consensus.cc:348] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.983825 7834 consensus_queue.cc:260] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.983873 7837 raft_consensus.cc:374] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:04:32.983925 7837 raft_consensus.cc:729] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84510fe26db643a79a65821f3a0c22e0, State: Initialized, Role: FOLLOWER
I20260808 21:04:32.984041 7837 consensus_queue.cc:260] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.984172 7834 ts_tablet_manager.cc:1428] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:04:32.984192 7820 heartbeater.cc:503] Master 127.14.146.254:43373 was elected leader, sending a full tablet report...
I20260808 21:04:32.984360 7837 ts_tablet_manager.cc:1428] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:04:32.984503 7594 heartbeater.cc:503] Master 127.14.146.254:43373 was elected leader, sending a full tablet report...
I20260808 21:04:32.987062 7841 raft_consensus.cc:482] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:04:32.987151 7841 raft_consensus.cc:504] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.987408 7841 leader_election.cc:288] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669), 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433)
I20260808 21:04:32.990185 7832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.987712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:47335 (local address 127.14.146.194:35669)
0808 21:04:32.987749 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.987750 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.987757 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:04:32.987777 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.987778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.987786 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.987854 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:32.988004 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.988501 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.989447 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.989830 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.989911 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.989920 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.990085 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.990118 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 21:04:32.990190 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.987665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:54633 (local address 127.14.146.193:42433)
0808 21:04:32.987746 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:32.987749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:32.987775 (+ 26us) server_negotiation.cc:407] Connection header received
0808 21:04:32.987852 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:32.987853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:32.987861 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:32.987906 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:04:32.988101 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.988560 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.989453 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.989829 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.989920 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.989928 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:32.990082 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 21:04:32.990121 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 21:04:32.990202 7822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.987538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:35669 (local address 127.14.146.195:47335)
0808 21:04:32.987577 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:32.987588 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:32.987633 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:32.987859 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:32.987860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:32.987862 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:32.987927 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.987929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.988597 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.988598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.989353 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.989355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.989908 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.989909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.989996 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.989999 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:04:32.990077 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 21:04:32.990118 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 21:04:32.990221 7843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:32.987540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42433 (local address 127.14.146.195:54633)
0808 21:04:32.987716 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:32.987728 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:32.987790 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:32.987921 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:32.987922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:32.987923 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:04:32.987995 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.987996 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.988637 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.988639 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.989366 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:32.989368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:32.989920 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:32.989921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:32.989999 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:32.990002 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:04:32.990074 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 21:04:32.990114 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":22,"thread_start_us":103,"threads_started":1}
I20260808 21:04:32.990540 7304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b25dd428d049edbe6c9dba8ecf6be7" candidate_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" is_pre_election: true
I20260808 21:04:32.990710 7304 raft_consensus.cc:2454] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8ff2dce61d4fd896e06746bcefc9a8 in term 0.
I20260808 21:04:32.990700 7529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b25dd428d049edbe6c9dba8ecf6be7" candidate_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84510fe26db643a79a65821f3a0c22e0" is_pre_election: true
I20260808 21:04:32.990842 7529 raft_consensus.cc:2454] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad8ff2dce61d4fd896e06746bcefc9a8 in term 0.
I20260808 21:04:32.990958 7629 leader_election.cc:302] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50defd2da9e54d2d82e76bdd5bfd5bed, ad8ff2dce61d4fd896e06746bcefc9a8; no voters:
I20260808 21:04:32.991074 7841 raft_consensus.cc:2781] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:04:32.991143 7841 raft_consensus.cc:482] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:04:32.991176 7841 raft_consensus.cc:3037] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:04:32.991837 7841 raft_consensus.cc:504] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.991987 7841 leader_election.cc:288] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669), 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433)
I20260808 21:04:32.992166 7529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b25dd428d049edbe6c9dba8ecf6be7" candidate_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84510fe26db643a79a65821f3a0c22e0"
I20260808 21:04:32.992203 7304 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83b25dd428d049edbe6c9dba8ecf6be7" candidate_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed"
I20260808 21:04:32.992245 7529 raft_consensus.cc:3037] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:04:32.992273 7304 raft_consensus.cc:3037] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:04:32.993172 7529 raft_consensus.cc:2454] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8ff2dce61d4fd896e06746bcefc9a8 in term 1.
I20260808 21:04:32.993378 7627 leader_election.cc:302] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84510fe26db643a79a65821f3a0c22e0, ad8ff2dce61d4fd896e06746bcefc9a8; no voters:
I20260808 21:04:32.993548 7841 raft_consensus.cc:2781] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:04:32.993613 7304 raft_consensus.cc:2454] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad8ff2dce61d4fd896e06746bcefc9a8 in term 1.
I20260808 21:04:32.993718 7841 raft_consensus.cc:686] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 LEADER]: Becoming Leader. State: Replica: ad8ff2dce61d4fd896e06746bcefc9a8, State: Running, Role: LEADER
I20260808 21:04:32.993811 7841 consensus_queue.cc:237] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:32.994554 7077 catalog_manager.cc:5495] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195). New cstate: current_term: 1 leader_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } health_report { overall_health: UNKNOWN } } }
I20260808 21:04:33.004513 7830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:33.002105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36564 (local address 127.14.146.195:43449)
0808 21:04:33.002163 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:33.002164 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:33.002172 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:04:33.002208 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:33.002209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:33.002225 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:33.002295 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:04:33.002435 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:33.002911 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:33.003656 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:33.003855 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:33.003938 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:33.004133 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:04:33.004188 (+ 55us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 21:04:33.004368 (+ 180us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36564: token expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 21:04:33.004575 7830 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36564: token expired
I20260808 21:04:33.010492 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:33.004880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48334 (local address 127.14.146.254:43373)
0808 21:04:33.004924 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:33.004925 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:33.004933 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:04:33.004955 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:33.004956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:33.004969 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:33.005012 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:33.005501 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:33.005949 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:33.006605 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:33.006794 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:33.006855 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:33.007973 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:33.007974 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:33.007975 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:33.007981 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:33.009551 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:33.009857 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:33.009857 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:33.009858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:33.009910 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:33.010068 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:33.010069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:33.010069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:33.010205 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:33.010280 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:33.010359 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 21:04:33.010427 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:04:33.013648 7830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:33.011353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36580 (local address 127.14.146.195:43449)
0808 21:04:33.011403 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:33.011405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:33.011416 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:04:33.011438 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:33.011439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:33.011450 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:33.011494 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:04:33.011586 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:33.012169 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:33.012848 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:33.013101 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:33.013175 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:33.013315 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:04:33.013420 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:04:33.013481 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:33.013544 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 21:04:33.013563 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:04:33.015498 7529 raft_consensus.cc:1261] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 1 FOLLOWER]: Refusing update from remote peer ad8ff2dce61d4fd896e06746bcefc9a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:04:33.015498 7304 raft_consensus.cc:1261] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Refusing update from remote peer ad8ff2dce61d4fd896e06746bcefc9a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:04:33.015861 7845 consensus_queue.cc:1035] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:04:33.015983 7841 consensus_queue.cc:1035] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:04:33.019002 7851 mvcc.cc:205] Tried to move back new op lower bound from 7316369707068801024 to 7316369706983350272. Current Snapshot: MvccSnapshot[applied={T|T < 7316369707068801024}]
I20260808 21:04:33.019189 7847 mvcc.cc:205] Tried to move back new op lower bound from 7316369707068801024 to 7316369706983350272. Current Snapshot: MvccSnapshot[applied={T|T < 7316369707068801024 or (T in {7316369707068801024})}]
I20260808 21:04:33.020352 7077 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:04:33.020443 7077 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:04:33.021142 7077 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Sending DeleteTablet for 3 replicas of tablet 83b25dd428d049edbe6c9dba8ecf6be7
I20260808 21:04:33.021456 7708 tablet_service.cc:1514] Processing DeleteTablet for tablet 83b25dd428d049edbe6c9dba8ecf6be7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:04:33 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:36560
I20260808 21:04:33.021678 7860 tablet_replica.cc:330] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: stopping tablet replica
I20260808 21:04:33.021692 7496 tablet_service.cc:1514] Processing DeleteTablet for tablet 83b25dd428d049edbe6c9dba8ecf6be7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:04:33 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:58934
I20260808 21:04:33.021790 7860 raft_consensus.cc:2229] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:04:33.021891 7860 raft_consensus.cc:2258] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:04:33.021909 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 7136
I20260808 21:04:33.021981 7861 tablet_replica.cc:330] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: stopping tablet replica
I20260808 21:04:33.022118 7861 raft_consensus.cc:2229] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:04:33.022291 7861 raft_consensus.cc:2258] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:04:33.027164 7861 ts_tablet_manager.cc:1905] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:04:33.028148 7860 ts_tablet_manager.cc:1905] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:04:33.029165 7861 ts_tablet_manager.cc:1918] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:04:33.029320 7861 log.cc:1196] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/83b25dd428d049edbe6c9dba8ecf6be7
I20260808 21:04:33.029723 7861 ts_tablet_manager.cc:1939] T 83b25dd428d049edbe6c9dba8ecf6be7 P 84510fe26db643a79a65821f3a0c22e0: Deleting consensus metadata
I20260808 21:04:33.030496 7860 ts_tablet_manager.cc:1918] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:04:33.030614 7860 log.cc:1196] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/83b25dd428d049edbe6c9dba8ecf6be7
I20260808 21:04:33.030992 7860 ts_tablet_manager.cc:1939] T 83b25dd428d049edbe6c9dba8ecf6be7 P ad8ff2dce61d4fd896e06746bcefc9a8: Deleting consensus metadata
I20260808 21:04:33.031527 7058 catalog_manager.cc:4841] TS ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449): tablet 83b25dd428d049edbe6c9dba8ecf6be7 (table test-table [id=fbedcea3b8034bdba1c97d0e038c0fc3]) successfully deleted
I20260808 21:04:33.039007 7059 catalog_manager.cc:4841] TS 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669): tablet 83b25dd428d049edbe6c9dba8ecf6be7 (table test-table [id=fbedcea3b8034bdba1c97d0e038c0fc3]) successfully deleted
W20260808 21:04:33.044239 7061 connection.cc:535] client connection to 127.14.146.193:42433 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 21:04:33.044368 7061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 21:04:33.044577 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 7389
I20260808 21:04:33.044865 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:33.044734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:42433 (local address 127.0.0.1:55960)
0808 21:04:33.044782 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:33.044815 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:42433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 21:04:33.049693 7061 catalog_manager.cc:4584] TS 50defd2da9e54d2d82e76bdd5bfd5bed (127.14.146.193:42433): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83b25dd428d049edbe6c9dba8ecf6be7: Network error: Client connection negotiation failed: client connection to 127.14.146.193:42433: connect: Connection refused (error 111)
I20260808 21:04:33.065537 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 7597
I20260808 21:04:33.079855 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 7032
I20260808 21:04:53.094313 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43373
--webserver_interface=127.14.146.254
--webserver_port=42025
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:43373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:04:53.178885 7864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:53.179157 7864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:53.179201 7864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:53.180408 7864 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 21:04:53.180477 7864 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 21:04:53.180500 7864 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 21:04:53.180526 7864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:04:53.180559 7864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:53.180586 7864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:53.180616 7864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:04:53.180646 7864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:04:53.182225 7864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:43373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=42025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:53.182550 7864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:53.182826 7864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 21:04:53.188575 7864 server_base.cc:1034] running on GCE node
W20260808 21:04:53.188566 7872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:53.188552 7876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:53.188529 7871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:53.189092 7864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:53.189368 7864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:53.190510 7864 hybrid_clock.cc:648] HybridClock initialized: now 1786223093190499 us; error 30 us; skew 500 ppm
Aug 08 21:04:53 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223093, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:53.193297 7864 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:04:53.193775 7864 webserver.cc:460] Webserver started at http://127.14.146.254:42025/ using document root <none> and password file <none>
I20260808 21:04:53.194034 7864 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:53.194084 7864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:53.195521 7864 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:53.196403 7887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:53.196635 7864 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:53.196761 7864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "87f20afcbbea4ca892da2f53c1812354"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "e3c424e8c2bef44f475bcf1146acf2cc"
server_key_iv: "a21456acde9833f768a2720e0f8ee70e"
server_key_version: "encryptionkey@0"
I20260808 21:04:53.197172 7864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:53.206645 7864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:53.208858 7864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:53.209036 7864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:53.213456 7864 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:43373
I20260808 21:04:53.213505 7969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:43373 every 8 connection(s)
I20260808 21:04:53.214061 7864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:04:53.215659 7971 sys_catalog.cc:263] Verifying existing consensus state
I20260808 21:04:53.216379 7971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Bootstrap starting.
I20260808 21:04:53.220650 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 7864
I20260808 21:04:53.220937 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:42433
--local_ip_for_outbound_sockets=127.14.146.193
--tserver_master_addrs=127.14.146.254:43373
--webserver_port=42875
--webserver_interface=127.14.146.193
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:04:53.225780 7971 log.cc:824] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:53.228160 7971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:04:53.228487 7971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Bootstrap complete.
I20260808 21:04:53.230945 7971 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:53.231388 7971 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87f20afcbbea4ca892da2f53c1812354, State: Initialized, Role: FOLLOWER
I20260808 21:04:53.231603 7971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:53.231702 7971 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:04:53.231756 7971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:04:53.231801 7971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 2 FOLLOWER]: Advancing to term 3
I20260808 21:04:53.233492 7971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:53.233613 7971 leader_election.cc:302] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87f20afcbbea4ca892da2f53c1812354; no voters:
I20260808 21:04:53.233808 7971 leader_election.cc:288] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 21:04:53.234010 7983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 21:04:53.234114 7971 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:04:53.234259 7983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [term 3 LEADER]: Becoming Leader. State: Replica: 87f20afcbbea4ca892da2f53c1812354, State: Running, Role: LEADER
I20260808 21:04:53.234418 7983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } }
I20260808 21:04:53.234808 7982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "87f20afcbbea4ca892da2f53c1812354" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } } }
I20260808 21:04:53.234908 7982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: This master's current role is: LEADER
I20260808 21:04:53.235073 7984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87f20afcbbea4ca892da2f53c1812354. Latest consensus state: current_term: 3 leader_uuid: "87f20afcbbea4ca892da2f53c1812354" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87f20afcbbea4ca892da2f53c1812354" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43373 } } }
I20260808 21:04:53.235150 7984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354 [sys.catalog]: This master's current role is: LEADER
I20260808 21:04:53.235481 7992 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:04:53.236644 7992 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:04:53.236750 7992 catalog_manager.cc:1259] Loaded cluster ID: 57869c62e30b434ca5cf16baab6ab80a
I20260808 21:04:53.236784 7992 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:04:53.238003 7992 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:04:53.238184 7992 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Loaded TSK: 0
I20260808 21:04:53.238227 7992 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 87f20afcbbea4ca892da2f53c1812354: Loaded TSK: 1
F20260808 21:04:53.238472 7992 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbb6e12c9ad google::LogMessage::Fail() at ??:0
@ 0x7fbb6e12f88a google::LogMessage::SendToLog() at ??:0
@ 0x7fbb6e12c4de google::LogMessage::Flush() at ??:0
@ 0x7fbb6e12da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbb70899104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fbb70896d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fbb760861cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fbb7608648e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fbb76086594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fbb7604cc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fbb76056ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbb6fffa0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbb6ffef954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbb70e536db start_thread at ??:0
@ 0x7fbb6cc2a61f clone at ??:0
W20260808 21:04:53.327786 7980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:53.328032 7980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:53.328070 7980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:53.329282 7980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:53.329357 7980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:53.329404 7980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:04:53.330942 7980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:42433
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=42875
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:53.331231 7980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:53.331480 7980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:53.337095 8039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:53.337078 8042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:53.337062 8040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:53.337460 7980 server_base.cc:1034] running on GCE node
I20260808 21:04:53.337677 7980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:53.337926 7980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:53.339107 7980 hybrid_clock.cc:648] HybridClock initialized: now 1786223093339100 us; error 54 us; skew 500 ppm
Aug 08 21:04:53 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223093, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:53.341975 7980 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:04:53.342495 7980 webserver.cc:460] Webserver started at http://127.14.146.193:42875/ using document root <none> and password file <none>
I20260808 21:04:53.342731 7980 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:53.342803 7980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:53.344290 7980 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:53.345106 8052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:53.345314 7980 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:53.345430 7980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "50defd2da9e54d2d82e76bdd5bfd5bed"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "0fe1451686ed01686a1cb0772aae496b"
server_key_iv: "0e52893caa2dfc2cee1ab1de141fc473"
server_key_version: "encryptionkey@0"
I20260808 21:04:53.345820 7980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:53.362854 7980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:53.365526 7980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:53.365715 7980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:53.366012 7980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:53.366547 8060 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 21:04:53.368643 7980 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 21:04:53.368716 7980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 21:04:53.368772 7980 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 21:04:53.369529 7980 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 21:04:53.369593 7980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 21:04:53.369664 8060 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Bootstrap starting.
I20260808 21:04:53.377954 7980 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:42433
I20260808 21:04:53.378149 8239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:42433 every 8 connection(s)
I20260808 21:04:53.378454 7980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:04:53.381599 8060 log.cc:824] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Log is configured to *not* fsync() on all Append() calls
I20260808 21:04:53.384369 8060 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 21:04:53.384694 8060 tablet_bootstrap.cc:492] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Bootstrap complete.
I20260808 21:04:53.385973 8060 ts_tablet_manager.cc:1397] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.003s
I20260808 21:04:53.387354 8060 raft_consensus.cc:348] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:53.387671 8060 raft_consensus.cc:729] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50defd2da9e54d2d82e76bdd5bfd5bed, State: Initialized, Role: FOLLOWER
I20260808 21:04:53.387826 8060 consensus_queue.cc:260] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:53.388054 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 7980
I20260808 21:04:53.388147 8060 ts_tablet_manager.cc:1428] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260808 21:04:53.388391 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:35669
--local_ip_for_outbound_sockets=127.14.146.194
--tserver_master_addrs=127.14.146.254:43373
--webserver_port=40159
--webserver_interface=127.14.146.194
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:04:53.472502 8244 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:04:53.379272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:59073)
0808 21:04:53.379465 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.379515 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:53.379995 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:53.472339 (+ 92344us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":101,"threads_started":1}
W20260808 21:04:53.472769 8240 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:43373 (0 consecutive failures): Network error: Failed to ping master at 127.14.146.254:43373: Client connection negotiation failed: client connection to 127.14.146.254:43373: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 21:04:53.473121 8244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:53.473003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:47107)
0808 21:04:53.473057 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.473103 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 21:04:53.473552 8244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:53.473462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:39627)
0808 21:04:53.473512 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.473535 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 21:04:53.473687 8240 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 21:04:53.502120 8248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:53.502302 8248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:53.502326 8248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:53.503479 8248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:53.503521 8248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:53.503575 8248 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:04:53.505087 8248 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:35669
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=40159
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:53.505318 8248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:53.505551 8248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:53.510533 8258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:53.510533 8255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:53.510555 8256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:53.510953 8248 server_base.cc:1034] running on GCE node
I20260808 21:04:53.511199 8248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:53.511426 8248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:53.512562 8248 hybrid_clock.cc:648] HybridClock initialized: now 1786223093512552 us; error 27 us; skew 500 ppm
Aug 08 21:04:53 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223093, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:53.515137 8248 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:04:53.515498 8248 webserver.cc:460] Webserver started at http://127.14.146.194:40159/ using document root <none> and password file <none>
I20260808 21:04:53.515673 8248 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:53.515713 8248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:53.517053 8248 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:53.517639 8268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:53.517814 8248 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:53.517921 8248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "84510fe26db643a79a65821f3a0c22e0"
format_stamp: "Formatted at 2026-08-08 21:04:11 on dist-test-slave-t3q3"
server_key: "d5493701b23afb403e10e3c965d7ff26"
server_key_iv: "a0905f5449901097b93e248e9b91cc88"
server_key_version: "encryptionkey@0"
I20260808 21:04:53.518249 8248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:53.531338 8248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:53.533672 8248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:53.533835 8248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:53.534065 8248 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:53.534364 8248 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:04:53.534420 8248 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:53.534459 8248 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:04:53.534487 8248 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:53.540534 8248 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:35669
I20260808 21:04:53.540580 8448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:35669 every 8 connection(s)
I20260808 21:04:53.540944 8248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:04:53.542003 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:53.541644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:46853)
0808 21:04:53.541797 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.541865 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
W20260808 21:04:53.542423 8449 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:43373 (0 consecutive failures): Network error: Failed to ping master at 127.14.146.254:43373: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
I20260808 21:04:53.542708 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:53.542616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:42311)
0808 21:04:53.542665 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.542691 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 21:04:53.543001 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:53.542920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:36375)
0808 21:04:53.542967 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.542988 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 21:04:53.543166 8449 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 21:04:53.547394 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 8248
I20260808 21:04:53.547672 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:43449
--local_ip_for_outbound_sockets=127.14.146.195
--tserver_master_addrs=127.14.146.254:43373
--webserver_port=34333
--webserver_interface=127.14.146.195
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:34941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:04:53.630749 8452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:04:53.630988 8452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:04:53.631031 8452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:04:53.632194 8452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:04:53.632261 8452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:04:53.632308 8452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:04:53.633780 8452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:34941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:43449
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=34333
--tserver_master_addrs=127.14.146.254:43373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:04:53.634061 8452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:04:53.634294 8452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:04:53.639547 8469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:53.639549 8468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:04:53.639592 8473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:04:53.639809 8452 server_base.cc:1034] running on GCE node
I20260808 21:04:53.640007 8452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:04:53.640318 8452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:04:53.641479 8452 hybrid_clock.cc:648] HybridClock initialized: now 1786223093641460 us; error 36 us; skew 500 ppm
Aug 08 21:04:53 dist-test-slave-t3q3 krb5kdc[6161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223093, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:04:53.648260 8452 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:04:53.648767 8452 webserver.cc:460] Webserver started at http://127.14.146.195:34333/ using document root <none> and password file <none>
I20260808 21:04:53.649032 8452 fs_manager.cc:359] Metadata directory not provided
I20260808 21:04:53.649097 8452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:04:53.650499 8452 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:04:53.651108 8482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:53.651285 8452 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:04:53.651388 8452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "ad8ff2dce61d4fd896e06746bcefc9a8"
format_stamp: "Formatted at 2026-08-08 21:04:12 on dist-test-slave-t3q3"
server_key: "148af51bca6ebe4e56882d65d3675727"
server_key_iv: "f32a2358119ad0866b191031b0aea20c"
server_key_version: "encryptionkey@0"
I20260808 21:04:53.651749 8452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:04:53.663906 8452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:04:53.665813 8452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:04:53.665982 8452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:04:53.666219 8452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:04:53.666553 8452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:04:53.666618 8452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:53.666653 8452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:04:53.666680 8452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:04:53.672555 8452 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:43449
I20260808 21:04:53.672607 8686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:43449 every 8 connection(s)
I20260808 21:04:53.673004 8452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:04:53.673519 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 8452
I20260808 21:04:53.674279 8689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:53.673776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:39279)
0808 21:04:53.673979 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.674082 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
W20260808 21:04:53.674739 8687 heartbeater.cc:644] Failed to heartbeat to 127.14.146.254:43373 (0 consecutive failures): Network error: Failed to ping master at 127.14.146.254:43373: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
I20260808 21:04:53.675024 8689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:53.674933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:46319)
0808 21:04:53.674979 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.675007 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 21:04:53.675251 8689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:53.675202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:60161)
0808 21:04:53.675222 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:53.675240 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260808 21:04:53.675352 8687 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 21:04:54.474331 8692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:54.474106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:38051)
0808 21:04:54.474228 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:54.474268 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260808 21:04:54.543713 8695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:54.543495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:49439)
0808 21:04:54.543621 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:54.543664 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260808 21:04:54.634390 8696 raft_consensus.cc:482] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:04:54.634570 8696 raft_consensus.cc:504] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:54.634938 8696 leader_election.cc:288] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449), 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669)
Aug 08 21:04:54 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223093, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.195@KRBTEST.COM
Aug 08 21:04:54 dist-test-slave-t3q3 krb5kdc[6161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223093, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.194@KRBTEST.COM
I20260808 21:04:54.645813 8700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:54.635319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:50215 (local address 127.14.146.195:43449)
0808 21:04:54.635475 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:54.635492 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:54.635510 (+ 18us) server_negotiation.cc:407] Connection header received
0808 21:04:54.635958 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:54.635961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:54.636021 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:54.636213 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:54.636952 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:54.637848 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:54.638862 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:54.639286 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:54.639415 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:54.641899 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:54.641904 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:54.641904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:54.641918 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:54.643973 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:54.644561 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:54.644564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:54.644564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:54.644682 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:54.644944 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:54.644945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:54.644946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:54.645190 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:54.645288 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:54.645577 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 21:04:54.645719 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260808 21:04:54.645813 8692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:54.635124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:35669 (local address 127.14.146.193:49635)
0808 21:04:54.635183 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:54.635198 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:54.635267 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:54.636257 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:54.636260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:54.636642 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:04:54.636831 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:54.636833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:54.637968 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:54.637969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:54.638752 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:54.638755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:54.639387 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:54.639389 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:54.639503 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:54.640131 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:04:54.640140 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:04:54.642303 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:04:54.644237 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:54.644238 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:54.644239 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:54.644461 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:54.644748 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:54.644749 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:54.644750 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:54.644860 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:54.645257 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:04:54.645265 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:04:54.645395 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 21:04:54.645500 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 21:04:54.645701 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":75}
I20260808 21:04:54.645839 8699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:54.635253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:49635 (local address 127.14.146.194:35669)
0808 21:04:54.635458 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 21:04:54.635470 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 21:04:54.635516 (+ 46us) server_negotiation.cc:407] Connection header received
0808 21:04:54.635957 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:04:54.635960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:04:54.636006 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:04:54.636225 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:04:54.636949 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:54.637847 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:54.638850 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:04:54.639286 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:04:54.639420 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:54.642417 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:04:54.642421 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:04:54.642421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:04:54.642431 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:04:54.644151 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:54.644570 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:54.644573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:54.644574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:54.644673 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:04:54.644937 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:04:54.644938 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:04:54.644938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:04:54.645181 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:04:54.645274 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 21:04:54.645570 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 21:04:54.645720 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":83,"threads_started":1}
I20260808 21:04:54.645925 8697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:54.635179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:43449 (local address 127.14.146.193:50215)
0808 21:04:54.635313 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:54.635324 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:04:54.635383 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:04:54.636317 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:04:54.636319 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:04:54.636643 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:04:54.636824 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:54.636829 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:54.637963 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:54.637964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:54.638755 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:04:54.638758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:04:54.639385 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:04:54.639386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:04:54.639510 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:04:54.640214 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:04:54.640218 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:04:54.641772 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:04:54.644091 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:54.644100 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:54.644102 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:54.644460 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:54.644784 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:04:54.644785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:04:54.644786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:04:54.644863 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:04:54.645288 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:04:54.645289 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:04:54.645396 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 21:04:54.645500 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 21:04:54.645789 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":119,"thread_start_us":58,"threads_started":1}
W20260808 21:04:54.647372 8053 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
W20260808 21:04:54.647464 8054 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
I20260808 21:04:54.647521 8054 leader_election.cc:302] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50defd2da9e54d2d82e76bdd5bfd5bed; no voters: 84510fe26db643a79a65821f3a0c22e0, ad8ff2dce61d4fd896e06746bcefc9a8
I20260808 21:04:54.647630 8696 raft_consensus.cc:2726] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:04:54.675848 8701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:54.675642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:37017)
0808 21:04:54.675770 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:54.675812 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
I20260808 21:04:55.475052 8702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:55.474846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:36125)
0808 21:04:55.474969 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:55.475004 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260808 21:04:55.544421 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:55.544227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:58731)
0808 21:04:55.544352 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:55.544385 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":74,"threads_started":1}
I20260808 21:04:55.676541 8705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:55.676322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:59207)
0808 21:04:55.676460 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:55.676501 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":64,"threads_started":1}
I20260808 21:04:56.203349 8708 raft_consensus.cc:482] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:04:56.203454 8708 raft_consensus.cc:504] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:56.203624 8708 leader_election.cc:288] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449), 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669)
W20260808 21:04:56.204113 8053 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
W20260808 21:04:56.204200 8054 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
I20260808 21:04:56.204233 8054 leader_election.cc:302] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50defd2da9e54d2d82e76bdd5bfd5bed; no voters: 84510fe26db643a79a65821f3a0c22e0, ad8ff2dce61d4fd896e06746bcefc9a8
I20260808 21:04:56.204310 8708 raft_consensus.cc:2726] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:04:56.475793 8709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:56.475562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:53377)
0808 21:04:56.475708 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:56.475747 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":67,"threads_started":1}
I20260808 21:04:56.545027 8711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:56.544838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:35311)
0808 21:04:56.544957 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:56.544991 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
I20260808 21:04:56.677294 8715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:56.677051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:60901)
0808 21:04:56.677216 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:56.677257 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":82,"threads_started":1}
I20260808 21:04:57.476554 8716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:57.476300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:46467)
0808 21:04:57.476436 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:57.476474 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":62,"threads_started":1}
I20260808 21:04:57.545658 8720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:57.545463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:45541)
0808 21:04:57.545585 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:57.545620 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
I20260808 21:04:57.677958 8721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:57.677737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:55759)
0808 21:04:57.677862 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:57.677915 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260808 21:04:58.477398 8728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:58.477171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:60889)
0808 21:04:58.477308 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:58.477351 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260808 21:04:58.546344 8732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:58.546125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:35329)
0808 21:04:58.546260 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:58.546301 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
I20260808 21:04:58.678692 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:58.678457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:51723)
0808 21:04:58.678614 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:58.678649 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260808 21:04:59.163033 8734 raft_consensus.cc:482] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:04:59.163133 8734 raft_consensus.cc:504] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:04:59.163316 8734 leader_election.cc:288] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449), 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669)
W20260808 21:04:59.163698 8053 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
W20260808 21:04:59.163801 8054 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
I20260808 21:04:59.163867 8054 leader_election.cc:302] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50defd2da9e54d2d82e76bdd5bfd5bed; no voters: 84510fe26db643a79a65821f3a0c22e0, ad8ff2dce61d4fd896e06746bcefc9a8
I20260808 21:04:59.163957 8734 raft_consensus.cc:2726] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:04:59.478178 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:59.477957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:41469)
0808 21:04:59.478089 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:59.478130 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":67,"threads_started":1}
I20260808 21:04:59.547067 8737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:59.546818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:55317)
0808 21:04:59.546978 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:59.547017 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":72,"threads_started":1}
I20260808 21:04:59.679382 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:04:59.679183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:45489)
0808 21:04:59.679303 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 21:04:59.679342 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
I20260808 21:05:00.478922 8739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:00.478697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:56865)
0808 21:05:00.478833 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:00.478874 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260808 21:05:00.547897 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:00.547670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:44645)
0808 21:05:00.547818 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:00.547854 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260808 21:05:00.680166 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:00.679885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:47755)
0808 21:05:00.680023 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:00.680109 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":67,"threads_started":1}
I20260808 21:05:00.776582 8744 raft_consensus.cc:482] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:05:00.776687 8744 raft_consensus.cc:504] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:05:00.776867 8744 leader_election.cc:288] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449), 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669)
W20260808 21:05:00.777367 8053 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
W20260808 21:05:00.777454 8054 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
I20260808 21:05:00.777504 8054 leader_election.cc:302] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50defd2da9e54d2d82e76bdd5bfd5bed; no voters: 84510fe26db643a79a65821f3a0c22e0, ad8ff2dce61d4fd896e06746bcefc9a8
I20260808 21:05:00.777601 8744 raft_consensus.cc:2726] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:05:01.479630 8745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:01.479412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:37687)
0808 21:05:01.479543 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:01.479583 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260808 21:05:01.548601 8746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:01.548353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:37725)
0808 21:05:01.548482 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:01.548521 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":82,"threads_started":1}
I20260808 21:05:01.680907 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:01.680681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:60169)
0808 21:05:01.680818 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:01.680863 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260808 21:05:02.480511 8750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:02.480272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:34279)
0808 21:05:02.480416 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:02.480462 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":70,"threads_started":1}
I20260808 21:05:02.549329 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:02.549105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:59653)
0808 21:05:02.549250 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:02.549286 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260808 21:05:02.681625 8753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:02.681401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:53311)
0808 21:05:02.681538 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:02.681580 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":63,"threads_started":1}
I20260808 21:05:03.481261 8754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:03.481030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:48643)
0808 21:05:03.481171 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:03.481214 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":67,"threads_started":1}
I20260808 21:05:03.550155 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:03.549922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:57221)
0808 21:05:03.550056 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:03.550105 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":64,"threads_started":1}
I20260808 21:05:03.682363 8757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:03.682117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:54447)
0808 21:05:03.682272 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:03.682316 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260808 21:05:04.481923 8759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:04.481719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:45601)
0808 21:05:04.481843 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:04.481876 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260808 21:05:04.550953 8761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:04.550711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:55037)
0808 21:05:04.550860 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:04.550906 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":65,"threads_started":1}
I20260808 21:05:04.683243 8762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:04.683007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:59329)
0808 21:05:04.683159 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:04.683196 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260808 21:05:05.482687 8763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:05.482440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:55025)
0808 21:05:05.482601 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:05.482640 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":74,"threads_started":1}
I20260808 21:05:05.551656 8765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:05.551440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:41905)
0808 21:05:05.551572 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:05.551607 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
I20260808 21:05:05.683940 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:05.683669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:40741)
0808 21:05:05.683854 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:05.683895 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":87,"threads_started":1}
I20260808 21:05:06.483433 8769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:06.483192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:40121)
0808 21:05:06.483340 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:06.483387 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260808 21:05:06.552440 8770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:06.552217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:40059)
0808 21:05:06.552357 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:06.552394 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
I20260808 21:05:06.684682 8771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:06.684438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:37379)
0808 21:05:06.684582 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:06.684625 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260808 21:05:07.484267 8772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:07.483961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:48517)
0808 21:05:07.484183 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:07.484221 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":144,"threads_started":1}
I20260808 21:05:07.553104 8773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:07.552827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:46703)
0808 21:05:07.552986 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:07.553053 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":77,"threads_started":1}
I20260808 21:05:07.685523 8775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:07.685221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:56817)
0808 21:05:07.685385 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:07.685430 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":66,"threads_started":1}
I20260808 21:05:08.321579 8776 raft_consensus.cc:482] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:05:08.321679 8776 raft_consensus.cc:504] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad8ff2dce61d4fd896e06746bcefc9a8" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 43449 } } peers { permanent_uuid: "84510fe26db643a79a65821f3a0c22e0" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 35669 } } peers { permanent_uuid: "50defd2da9e54d2d82e76bdd5bfd5bed" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 42433 } }
I20260808 21:05:08.321846 8776 leader_election.cc:288] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449), 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669)
W20260808 21:05:08.322252 8054 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 84510fe26db643a79a65821f3a0c22e0 (127.14.146.194:35669): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
W20260808 21:05:08.322353 8053 leader_election.cc:341] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ad8ff2dce61d4fd896e06746bcefc9a8 (127.14.146.195:43449): Not found: Tablet not found: 83b25dd428d049edbe6c9dba8ecf6be7
I20260808 21:05:08.322433 8053 leader_election.cc:302] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 50defd2da9e54d2d82e76bdd5bfd5bed; no voters: 84510fe26db643a79a65821f3a0c22e0, ad8ff2dce61d4fd896e06746bcefc9a8
I20260808 21:05:08.322547 8776 raft_consensus.cc:2726] T 83b25dd428d049edbe6c9dba8ecf6be7 P 50defd2da9e54d2d82e76bdd5bfd5bed [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 21:05:08.485019 8778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:08.484772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.193:46819)
0808 21:05:08.484922 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:08.484973 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260808 21:05:08.553791 8779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:08.553598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.194:52561)
0808 21:05:08.553715 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:08.553750 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":58,"threads_started":1}
I20260808 21:05:08.682763 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 7980
I20260808 21:05:08.691473 8781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:08.691144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43373 (local address 127.14.146.195:34289)
0808 21:05:08.691365 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:08.691409 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.254:43373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":62,"threads_started":1}
I20260808 21:05:08.696369 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 8248
I20260808 21:05:08.707820 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 8452
2026-08-08T21:05:08Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58683 ms)
[----------] 30 tests from SecurityITest (238250 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:08 dist-test-slave-t3q3 krb5kdc[8786](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:08 dist-test-slave-t3q3 krb5kdc[8786](info): set up 2 sockets
Aug 08 21:05:08 dist-test-slave-t3q3 krb5kdc[8786](info): commencing operation
krb5kdc: starting...
W20260808 21:05:09.967051 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:10.094801 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:38441
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:38441
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:10.177251 8812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:10.177488 8812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:10.177527 8812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:10.178651 8812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:10.178731 8812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:10.178758 8812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:10.178786 8812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:10.178810 8812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:10.180320 8812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:38441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:38441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:10.180588 8812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:10.180830 8812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 21:05:10.186190 8812 server_base.cc:1034] running on GCE node
W20260808 21:05:10.186201 8819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:10.186195 8823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:10.186371 8820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:10.186806 8812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:10.187105 8812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:10.188268 8812 hybrid_clock.cc:648] HybridClock initialized: now 1786223110188262 us; error 50 us; skew 500 ppm
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:10.190752 8812 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:10.191247 8812 webserver.cc:460] Webserver started at http://127.14.146.254:40379/ using document root <none> and password file <none>
I20260808 21:05:10.191493 8812 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:10.191561 8812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:10.191720 8812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:10.192824 8812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "b82d4932f7c24edb90d3efc8bcd490d1"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "cf668ea600fe1ee4247cb3a3cc8315cf"
server_key_iv: "6aefd1c03b172911fce18901a8b81731"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.193212 8812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "b82d4932f7c24edb90d3efc8bcd490d1"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "cf668ea600fe1ee4247cb3a3cc8315cf"
server_key_iv: "6aefd1c03b172911fce18901a8b81731"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.194568 8812 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:05:10.195312 8834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.195511 8812 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:05:10.195617 8812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "b82d4932f7c24edb90d3efc8bcd490d1"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "cf668ea600fe1ee4247cb3a3cc8315cf"
server_key_iv: "6aefd1c03b172911fce18901a8b81731"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.195691 8812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:10.227180 8812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:10.229319 8812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:10.229512 8812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:10.233749 8812 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:38441
I20260808 21:05:10.233788 8927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:38441 every 8 connection(s)
I20260808 21:05:10.234166 8812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:10.235102 8928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:10.237540 8928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1: Bootstrap starting.
I20260808 21:05:10.238091 8928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:10.238330 8928 log.cc:824] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:10.239001 8928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1: No bootstrap required, opened a new log
I20260808 21:05:10.240245 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 8812
I20260808 21:05:10.240365 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:10.240576 14923 external_mini_cluster.cc:1428] Setting key e54ca48c2ad434ce0e569989e6a93fe5
I20260808 21:05:10.240790 8928 raft_consensus.cc:348] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82d4932f7c24edb90d3efc8bcd490d1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 38441 } }
I20260808 21:05:10.240983 8928 raft_consensus.cc:374] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:10.241081 8928 raft_consensus.cc:729] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82d4932f7c24edb90d3efc8bcd490d1, State: Initialized, Role: FOLLOWER
I20260808 21:05:10.241217 8928 consensus_queue.cc:260] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82d4932f7c24edb90d3efc8bcd490d1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 38441 } }
I20260808 21:05:10.241315 8928 raft_consensus.cc:388] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:10.241379 8928 raft_consensus.cc:482] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:10.241430 8928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:10.242190 8928 raft_consensus.cc:504] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82d4932f7c24edb90d3efc8bcd490d1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 38441 } }
I20260808 21:05:10.242303 8928 leader_election.cc:302] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b82d4932f7c24edb90d3efc8bcd490d1; no voters:
I20260808 21:05:10.242456 8928 leader_election.cc:288] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:10.242532 8937 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:10.242698 8928 sys_catalog.cc:564] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:10.242712 8937 raft_consensus.cc:686] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [term 1 LEADER]: Becoming Leader. State: Replica: b82d4932f7c24edb90d3efc8bcd490d1, State: Running, Role: LEADER
I20260808 21:05:10.242935 8937 consensus_queue.cc:237] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82d4932f7c24edb90d3efc8bcd490d1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 38441 } }
I20260808 21:05:10.243407 8938 sys_catalog.cc:455] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b82d4932f7c24edb90d3efc8bcd490d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82d4932f7c24edb90d3efc8bcd490d1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 38441 } } }
I20260808 21:05:10.243502 8938 sys_catalog.cc:458] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:10.243927 8939 sys_catalog.cc:455] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b82d4932f7c24edb90d3efc8bcd490d1. Latest consensus state: current_term: 1 leader_uuid: "b82d4932f7c24edb90d3efc8bcd490d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b82d4932f7c24edb90d3efc8bcd490d1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 38441 } } }
I20260808 21:05:10.244041 8939 sys_catalog.cc:458] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:10.244207 8955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:10.244748 8955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:10.246546 8955 catalog_manager.cc:1347] Generated new cluster ID: ba6375ed4b01456c85d49ad01c7f9dd0
I20260808 21:05:10.246611 8955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:10.252427 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.241100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58340 (local address 127.14.146.254:38441)
0808 21:05:10.241293 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:10.241302 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:10.241337 (+ 35us) server_negotiation.cc:407] Connection header received
0808 21:05:10.241468 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:10.241475 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:10.241532 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:10.241679 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:10.242257 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.243702 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.244824 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.245425 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.245537 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.248154 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:10.248159 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:10.248159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:10.248171 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:10.250190 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.250584 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.250587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.250588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.251152 (+ 564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.251365 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.251366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.251366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.251686 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:10.251864 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:10.251934 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 21:05:10.252220 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":106,"threads_started":1}
I20260808 21:05:10.262739 8955 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:10.263245 8955 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:10.266634 8955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1: Generated new TSK 0
I20260808 21:05:10.266820 8955 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:05:10.297219 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:38441
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:10.386797 8972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:10.387006 8972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:10.387030 8972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:10.388250 8972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:10.388291 8972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:10.388319 8972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:05:10.389756 8972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:38441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:10.389950 8972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:10.390192 8972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:10.395311 8980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:10.395313 8979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:10.395303 8983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:10.395687 8972 server_base.cc:1034] running on GCE node
I20260808 21:05:10.395897 8972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:10.396200 8972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:10.397367 8972 hybrid_clock.cc:648] HybridClock initialized: now 1786223110397353 us; error 46 us; skew 500 ppm
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:10.399927 8972 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:05:10.400409 8972 webserver.cc:460] Webserver started at http://127.14.146.193:44635/ using document root <none> and password file <none>
I20260808 21:05:10.400635 8972 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:10.400712 8972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:10.400870 8972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:10.401901 8972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "8048a15554744b5a816542ca3e9d3357"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "3ac0649b08bd53f0d7b0193b6cbab2b7"
server_key_iv: "adf83e03bac8eff11349709b95aa9f34"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.402279 8972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "8048a15554744b5a816542ca3e9d3357"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "3ac0649b08bd53f0d7b0193b6cbab2b7"
server_key_iv: "adf83e03bac8eff11349709b95aa9f34"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.403637 8972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:10.404600 8997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.404769 8972 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:05:10.404876 8972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "8048a15554744b5a816542ca3e9d3357"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "3ac0649b08bd53f0d7b0193b6cbab2b7"
server_key_iv: "adf83e03bac8eff11349709b95aa9f34"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.404958 8972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:10.422565 8972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:10.424528 8972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:10.424696 8972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:10.424957 8972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:10.425275 8972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:10.425331 8972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.425371 8972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:10.425400 8972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.431329 8972 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:45063
I20260808 21:05:10.431375 9177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:45063 every 8 connection(s)
I20260808 21:05:10.431682 8972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:05:10.433314 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 8972
I20260808 21:05:10.433430 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:05:10.433650 14923 external_mini_cluster.cc:1428] Setting key 10ea4eb1229779dafd9a33114690989d
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:10.441756 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.432509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:37779 (local address 127.14.146.254:38441)
0808 21:05:10.432583 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:10.432585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:10.432773 (+ 188us) server_negotiation.cc:407] Connection header received
0808 21:05:10.433267 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:10.433268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:10.433283 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:10.433368 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:10.434401 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.434915 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.435942 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.436287 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.436364 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.438762 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:10.438763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:10.438764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:10.438772 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:10.440361 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.440774 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.440775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.440776 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.440840 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.441099 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.441100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.441100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.441222 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:10.441295 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:10.441573 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 21:05:10.441663 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 21:05:10.441959 9182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.432473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:38441 (local address 127.14.146.193:37779)
0808 21:05:10.432630 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:10.432672 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:10.433163 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:10.433457 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:10.433461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:10.434096 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:10.434290 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.434294 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.435016 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.435017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.435839 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.435841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.436382 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.436383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.436495 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.437037 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:10.437045 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:10.438651 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:10.440445 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:10.440453 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:10.440456 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:10.440678 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:10.440910 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:10.440911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:10.440911 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:10.441020 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:10.441300 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:10.441307 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:10.441440 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 21:05:10.441550 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 21:05:10.441723 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260808 21:05:10.442554 9178 heartbeater.cc:347] Connected to a master server at 127.14.146.254:38441
I20260808 21:05:10.442672 9178 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:10.442889 9178 heartbeater.cc:511] Master 127.14.146.254:38441 requested a full tablet report, sending...
I20260808 21:05:10.443512 8862 ts_manager.cc:194] Registered new tserver with Master: 8048a15554744b5a816542ca3e9d3357 (127.14.146.193:45063)
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:05:10.444401 8862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:37779
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:05:10.461107 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:38441
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:10.543933 9188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:10.544227 9188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:10.544270 9188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:10.545426 9188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:10.545495 9188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:10.545539 9188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:05:10.547009 9188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:38441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:10.547278 9188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:10.547518 9188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:10.552536 9201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:10.552603 9197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:10.552706 9188 server_base.cc:1034] running on GCE node
W20260808 21:05:10.552551 9196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:10.552950 9188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:10.553215 9188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:10.554378 9188 hybrid_clock.cc:648] HybridClock initialized: now 1786223110554375 us; error 34 us; skew 500 ppm
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:10.556874 9188 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:05:10.557356 9188 webserver.cc:460] Webserver started at http://127.14.146.194:43701/ using document root <none> and password file <none>
I20260808 21:05:10.557600 9188 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:10.557677 9188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:10.557830 9188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:10.558862 9188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "037df660bc7e4ba4969173c833d81fc2"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "88307c374c408038bd3a07ac041af1a8"
server_key_iv: "3d587a56d21ff9fea19b9607ee0e2c5c"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.559224 9188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "037df660bc7e4ba4969173c833d81fc2"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "88307c374c408038bd3a07ac041af1a8"
server_key_iv: "3d587a56d21ff9fea19b9607ee0e2c5c"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.560655 9188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:10.561380 9213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.561550 9188 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:05:10.561668 9188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "037df660bc7e4ba4969173c833d81fc2"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "88307c374c408038bd3a07ac041af1a8"
server_key_iv: "3d587a56d21ff9fea19b9607ee0e2c5c"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.561741 9188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:10.574410 9188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:10.576212 9188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:10.576373 9188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:10.576596 9188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:10.576908 9188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:10.576964 9188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.577004 9188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:10.577032 9188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.582841 9188 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:43599
I20260808 21:05:10.582890 9401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:43599 every 8 connection(s)
I20260808 21:05:10.583191 9188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:05:10.586593 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 9188
I20260808 21:05:10.586722 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:05:10.586938 14923 external_mini_cluster.cc:1428] Setting key a21a561d666aaa1297102d862e30db82
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:10.593220 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.583881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:53891 (local address 127.14.146.254:38441)
0808 21:05:10.583971 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:10.583974 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:10.584210 (+ 236us) server_negotiation.cc:407] Connection header received
0808 21:05:10.584732 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:10.584734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:10.584746 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:10.584811 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:10.585737 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.586258 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.587592 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.587829 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.587911 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.590092 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:10.590094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:10.590094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:10.590103 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:10.591520 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.592017 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.592018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.592019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.592136 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.592480 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.592481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.592481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.592625 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:10.592706 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:10.593070 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 21:05:10.593157 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 21:05:10.593534 9407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.583831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:38441 (local address 127.14.146.194:53891)
0808 21:05:10.584011 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:10.584097 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:10.584625 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:10.584878 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:10.584883 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:10.585450 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:10.585636 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.585641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.586359 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.586360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.587505 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.587508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.587933 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.587935 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.588107 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.588640 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:10.588649 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:10.589999 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:10.591604 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:10.591612 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:10.591614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:10.591928 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:10.592236 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:10.592237 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:10.592238 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:10.592406 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:10.592712 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:10.592719 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:10.592900 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 21:05:10.593043 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 21:05:10.593235 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260808 21:05:10.594103 9404 heartbeater.cc:347] Connected to a master server at 127.14.146.254:38441
I20260808 21:05:10.594205 9404 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:10.594393 9404 heartbeater.cc:511] Master 127.14.146.254:38441 requested a full tablet report, sending...
I20260808 21:05:10.594841 8862 ts_manager.cc:194] Registered new tserver with Master: 037df660bc7e4ba4969173c833d81fc2 (127.14.146.194:43599)
I20260808 21:05:10.595230 8862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:53891
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:05:10.615202 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:38441
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:10.702952 9412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:10.703172 9412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:10.703197 9412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:10.704483 9412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:10.704527 9412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:10.704555 9412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:05:10.705994 9412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:38441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:10.706197 9412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:10.706379 9412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:10.711732 9419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:10.711802 9420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:10.711889 9412 server_base.cc:1034] running on GCE node
W20260808 21:05:10.711728 9424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:10.712234 9412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:10.712546 9412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:10.713714 9412 hybrid_clock.cc:648] HybridClock initialized: now 1786223110713710 us; error 36 us; skew 500 ppm
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:10.716388 9412 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:05:10.716842 9412 webserver.cc:460] Webserver started at http://127.14.146.195:38597/ using document root <none> and password file <none>
I20260808 21:05:10.717095 9412 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:10.717170 9412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:10.717329 9412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:10.718416 9412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "9577d965a440412ebd5906cae4ec965d"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "0569abbcca1811d658ea055e007990f5"
server_key_iv: "e8df4c9e61c54d6922eb5458ec0cd5b7"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.718786 9412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "9577d965a440412ebd5906cae4ec965d"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "0569abbcca1811d658ea055e007990f5"
server_key_iv: "e8df4c9e61c54d6922eb5458ec0cd5b7"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.720227 9412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:10.721073 9440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.721276 9412 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:10.721380 9412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "9577d965a440412ebd5906cae4ec965d"
format_stamp: "Formatted at 2026-08-08 21:05:10 on dist-test-slave-t3q3"
server_key: "0569abbcca1811d658ea055e007990f5"
server_key_iv: "e8df4c9e61c54d6922eb5458ec0cd5b7"
server_key_version: "encryptionkey@0"
I20260808 21:05:10.721462 9412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:10.769471 9412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:10.771454 9412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:10.771622 9412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:10.771865 9412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:10.772238 9412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:10.772291 9412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.772334 9412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:10.772360 9412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:10.778285 9412 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:37269
I20260808 21:05:10.778334 9635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:37269 every 8 connection(s)
I20260808 21:05:10.778692 9412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:05:10.781653 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 9412
I20260808 21:05:10.781751 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:05:10.781932 14923 external_mini_cluster.cc:1428] Setting key 2f438196e0323bfc72c02f742a53badf
Aug 08 21:05:10 dist-test-slave-t3q3 krb5kdc[8786](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223110, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:10.788486 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.779494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:40827 (local address 127.14.146.254:38441)
0808 21:05:10.779557 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:10.779559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:10.779725 (+ 166us) server_negotiation.cc:407] Connection header received
0808 21:05:10.780305 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:10.780306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:10.780317 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:10.780373 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:10.781282 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.782031 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.783293 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.783481 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.783538 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.785576 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:10.785578 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:10.785578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:10.785585 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:10.786984 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.787430 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.787431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.787432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.787495 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.787767 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.787768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.787768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.787886 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:10.787959 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:10.788312 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 21:05:10.788395 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:05:10.788674 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.779441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:38441 (local address 127.14.146.195:40827)
0808 21:05:10.779598 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:10.779639 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:10.780193 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:10.780435 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:10.780438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:10.781011 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:10.781202 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.781207 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.782131 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.782132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.783221 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.783224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.783553 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.783554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.783658 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.784128 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:10.784137 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:10.785463 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:10.787110 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:10.787116 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:10.787118 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:10.787348 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:10.787574 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:10.787574 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:10.787575 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:10.787687 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:10.787964 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:10.787970 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:10.788176 (+ 206us) client_negotiation.cc:769] Sending connection context
0808 21:05:10.788290 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 21:05:10.788444 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
I20260808 21:05:10.789194 9636 heartbeater.cc:347] Connected to a master server at 127.14.146.254:38441
I20260808 21:05:10.789278 9636 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:10.789414 9636 heartbeater.cc:511] Master 127.14.146.254:38441 requested a full tablet report, sending...
I20260808 21:05:10.789724 8862 ts_manager.cc:194] Registered new tserver with Master: 9577d965a440412ebd5906cae4ec965d (127.14.146.195:37269)
I20260808 21:05:10.790095 8862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:40827
I20260808 21:05:10.793735 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:05:10.801091 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.795096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58344 (local address 127.14.146.254:38441)
0808 21:05:10.795175 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:10.795177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:10.795274 (+ 97us) server_negotiation.cc:407] Connection header received
0808 21:05:10.795354 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:10.795354 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:10.795371 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:10.795434 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:10.795989 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.796525 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.797248 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.797440 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.797530 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.798733 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:10.798735 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:10.798735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:10.798743 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:10.800038 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.800407 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.800408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.800408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.800463 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:10.800638 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:10.800638 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:10.800639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:10.800776 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:10.800849 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:10.800971 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 21:05:10.801032 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 21:05:10.802526 8862 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:05:10.804036 8862 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:05:10.810909 9662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.806691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48602 (local address 127.14.146.193:45063)
0808 21:05:10.806862 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:10.806867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:10.806961 (+ 94us) server_negotiation.cc:407] Connection header received
0808 21:05:10.807012 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:10.807016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:10.807033 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:10.807178 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:10.807392 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.808494 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.809725 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.810480 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.810557 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.810613 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:10.810771 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 21:05:10.810820 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260808 21:05:10.810884 9658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.806413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:45063 (local address 127.0.0.1:48602)
0808 21:05:10.806873 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:10.806884 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:10.806944 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:10.807261 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:10.807262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:10.807264 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:10.807310 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.807313 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.808593 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.808594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.809636 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.809639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.810570 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.810572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.810652 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.810669 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 21:05:10.810744 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 21:05:10.810797 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":31,"thread_start_us":93,"threads_started":1}
I20260808 21:05:10.810989 9655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.806380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:37269 (local address 127.0.0.1:44504)
0808 21:05:10.806560 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:10.806601 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:10.806673 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:10.806884 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:10.806888 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:10.806890 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:10.806982 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.806984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.808387 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.808388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.809713 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.809716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.810651 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.810652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.810745 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.810750 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:05:10.810806 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 21:05:10.810845 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":48,"threads_started":1}
I20260808 21:05:10.811300 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.806456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44504 (local address 127.14.146.195:37269)
0808 21:05:10.806647 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:10.806652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:10.806662 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:10.806767 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:10.806769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:10.806785 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:10.806866 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:10.807061 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.808285 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.809785 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.810480 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.810557 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.810613 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:10.810924 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 21:05:10.810972 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":86,"threads_started":1}
I20260808 21:05:10.811429 9653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.806413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:43599 (local address 127.0.0.1:51208)
0808 21:05:10.807113 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:10.807123 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:10.807170 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:10.807484 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:10.807485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:10.807487 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:10.807519 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.807520 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.808665 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.808665 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.809894 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:10.809896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.811172 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.811173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:10.811233 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.811238 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:05:10.811288 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 21:05:10.811332 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"mutex_wait_us":36,"thread_start_us":92,"threads_started":1}
I20260808 21:05:10.811484 9660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:10.806668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51208 (local address 127.14.146.194:43599)
0808 21:05:10.807070 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:10.807074 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:10.807281 (+ 207us) server_negotiation.cc:407] Connection header received
0808 21:05:10.807327 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:10.807329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:10.807346 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:10.807409 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:10.807596 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.808542 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.809983 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:10.810676 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:10.810756 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:10.810808 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:10.811335 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 21:05:10.811381 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":88,"threads_started":1}
I20260808 21:05:10.811972 9509 tablet_service.cc:1467] Processing CreateTablet for tablet 948ed97b7761445d8dd56af1002f4da3 (DEFAULT_TABLE table=test-table [id=8dfaf6fc9f054d77b59939240892661a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:10.812122 9069 tablet_service.cc:1467] Processing CreateTablet for tablet 948ed97b7761445d8dd56af1002f4da3 (DEFAULT_TABLE table=test-table [id=8dfaf6fc9f054d77b59939240892661a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:10.812386 9509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948ed97b7761445d8dd56af1002f4da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:10.812422 9069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948ed97b7761445d8dd56af1002f4da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:10.812338 9289 tablet_service.cc:1467] Processing CreateTablet for tablet 948ed97b7761445d8dd56af1002f4da3 (DEFAULT_TABLE table=test-table [id=8dfaf6fc9f054d77b59939240892661a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:10.812686 9289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 948ed97b7761445d8dd56af1002f4da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:10.815330 9664 tablet_bootstrap.cc:492] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Bootstrap starting.
I20260808 21:05:10.815915 9667 tablet_bootstrap.cc:492] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Bootstrap starting.
I20260808 21:05:10.816107 9664 tablet_bootstrap.cc:654] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:10.816644 9667 tablet_bootstrap.cc:654] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:10.816761 9664 log.cc:824] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:10.817178 9667 log.cc:824] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:10.817466 9666 tablet_bootstrap.cc:492] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357: Bootstrap starting.
I20260808 21:05:10.817644 9664 tablet_bootstrap.cc:492] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: No bootstrap required, opened a new log
I20260808 21:05:10.817714 9664 ts_tablet_manager.cc:1397] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:05:10.817895 9667 tablet_bootstrap.cc:492] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: No bootstrap required, opened a new log
I20260808 21:05:10.817966 9667 ts_tablet_manager.cc:1397] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:10.818275 9666 tablet_bootstrap.cc:654] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:10.818872 9666 log.cc:824] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:10.819600 9667 raft_consensus.cc:348] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:10.819701 9666 tablet_bootstrap.cc:492] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357: No bootstrap required, opened a new log
I20260808 21:05:10.819768 9667 raft_consensus.cc:374] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:10.819792 9666 ts_tablet_manager.cc:1397] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 21:05:10.819814 9667 raft_consensus.cc:729] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9577d965a440412ebd5906cae4ec965d, State: Initialized, Role: FOLLOWER
I20260808 21:05:10.819934 9667 consensus_queue.cc:260] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:10.819855 9664 raft_consensus.cc:348] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:10.820034 9664 raft_consensus.cc:374] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:10.820120 9664 raft_consensus.cc:729] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 037df660bc7e4ba4969173c833d81fc2, State: Initialized, Role: FOLLOWER
I20260808 21:05:10.820253 9667 ts_tablet_manager.cc:1428] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:05:10.820258 9664 consensus_queue.cc:260] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:10.820387 9636 heartbeater.cc:503] Master 127.14.146.254:38441 was elected leader, sending a full tablet report...
I20260808 21:05:10.820533 9664 ts_tablet_manager.cc:1428] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 21:05:10.820665 9404 heartbeater.cc:503] Master 127.14.146.254:38441 was elected leader, sending a full tablet report...
I20260808 21:05:10.821775 9666 raft_consensus.cc:348] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:10.821942 9666 raft_consensus.cc:374] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:10.821986 9666 raft_consensus.cc:729] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8048a15554744b5a816542ca3e9d3357, State: Initialized, Role: FOLLOWER
I20260808 21:05:10.822099 9666 consensus_queue.cc:260] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:10.822412 9666 ts_tablet_manager.cc:1428] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:05:10.822450 9178 heartbeater.cc:503] Master 127.14.146.254:38441 was elected leader, sending a full tablet report...
W20260808 21:05:10.833741 9406 tablet.cc:2369] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:05:10.932520 9180 tablet.cc:2369] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 21:05:11.029277 9638 tablet.cc:2369] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:05:11.041023 9677 raft_consensus.cc:482] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:05:11.041147 9677 raft_consensus.cc:504] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:11.041522 9677 leader_election.cc:288] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9577d965a440412ebd5906cae4ec965d (127.14.146.195:37269), 037df660bc7e4ba4969173c833d81fc2 (127.14.146.194:43599)
I20260808 21:05:11.044806 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.041791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:58973 (local address 127.14.146.195:37269)
0808 21:05:11.041883 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.041885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.041896 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:05:11.041976 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.041977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.041987 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.042070 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:11.042241 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.042719 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.043977 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.044430 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.044519 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.044529 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.044692 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.044728 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 21:05:11.044806 9660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.041823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:47875 (local address 127.14.146.194:43599)
0808 21:05:11.041901 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.041904 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.041933 (+ 29us) server_negotiation.cc:407] Connection header received
0808 21:05:11.042036 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.042037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.042049 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.042133 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:11.042304 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.042812 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.043955 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.044423 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.044511 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.044521 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.044685 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.044724 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:05:11.044854 9680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.041728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:43599 (local address 127.14.146.193:47875)
0808 21:05:11.041865 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.041878 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.041952 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.042136 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.042137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.042139 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:11.042227 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.042229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.042896 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.042897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.043814 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.043817 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.044511 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.044512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.044595 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.044599 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.044676 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.044725 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260808 21:05:11.044860 9679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.041689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:37269 (local address 127.14.146.193:58973)
0808 21:05:11.041839 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.041850 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.041913 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.042076 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.042077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.042079 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:11.042161 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.042163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.042835 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.042836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.043816 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.043819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.044519 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.044521 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.044596 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.044606 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.044671 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.044723 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":125,"thread_start_us":78,"threads_started":1}
I20260808 21:05:11.045224 9322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948ed97b7761445d8dd56af1002f4da3" candidate_uuid: "8048a15554744b5a816542ca3e9d3357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "037df660bc7e4ba4969173c833d81fc2" is_pre_election: true
I20260808 21:05:11.045401 9322 raft_consensus.cc:2454] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8048a15554744b5a816542ca3e9d3357 in term 0.
I20260808 21:05:11.045364 9545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948ed97b7761445d8dd56af1002f4da3" candidate_uuid: "8048a15554744b5a816542ca3e9d3357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9577d965a440412ebd5906cae4ec965d" is_pre_election: true
I20260808 21:05:11.045507 9545 raft_consensus.cc:2454] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8048a15554744b5a816542ca3e9d3357 in term 0.
I20260808 21:05:11.045660 9002 leader_election.cc:302] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 037df660bc7e4ba4969173c833d81fc2, 8048a15554744b5a816542ca3e9d3357; no voters:
I20260808 21:05:11.045825 9677 raft_consensus.cc:2781] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:05:11.045884 9677 raft_consensus.cc:482] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:05:11.045917 9677 raft_consensus.cc:3037] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:11.046608 9677 raft_consensus.cc:504] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:11.046749 9677 leader_election.cc:288] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [CANDIDATE]: Term 1 election: Requested vote from peers 9577d965a440412ebd5906cae4ec965d (127.14.146.195:37269), 037df660bc7e4ba4969173c833d81fc2 (127.14.146.194:43599)
I20260808 21:05:11.046929 9545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948ed97b7761445d8dd56af1002f4da3" candidate_uuid: "8048a15554744b5a816542ca3e9d3357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9577d965a440412ebd5906cae4ec965d"
I20260808 21:05:11.046938 9322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "948ed97b7761445d8dd56af1002f4da3" candidate_uuid: "8048a15554744b5a816542ca3e9d3357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "037df660bc7e4ba4969173c833d81fc2"
I20260808 21:05:11.047016 9322 raft_consensus.cc:3037] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:11.047016 9545 raft_consensus.cc:3037] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:11.047902 9322 raft_consensus.cc:2454] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8048a15554744b5a816542ca3e9d3357 in term 1.
I20260808 21:05:11.047902 9545 raft_consensus.cc:2454] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8048a15554744b5a816542ca3e9d3357 in term 1.
I20260808 21:05:11.048120 9001 leader_election.cc:302] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8048a15554744b5a816542ca3e9d3357, 9577d965a440412ebd5906cae4ec965d; no voters:
I20260808 21:05:11.048245 9677 raft_consensus.cc:2781] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:11.048429 9677 raft_consensus.cc:686] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 1 LEADER]: Becoming Leader. State: Replica: 8048a15554744b5a816542ca3e9d3357, State: Running, Role: LEADER
I20260808 21:05:11.048542 9677 consensus_queue.cc:237] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } }
I20260808 21:05:11.049396 8862 catalog_manager.cc:5495] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8048a15554744b5a816542ca3e9d3357 (127.14.146.193). New cstate: current_term: 1 leader_uuid: "8048a15554744b5a816542ca3e9d3357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8048a15554744b5a816542ca3e9d3357" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 45063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 } health_report { overall_health: UNKNOWN } } }
I20260808 21:05:11.092258 9662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.089961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48606 (local address 127.14.146.193:45063)
0808 21:05:11.090030 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.090032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.090043 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:05:11.090085 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.090086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.090108 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.090174 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:11.090309 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.090787 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.091487 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.091676 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.091727 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.091868 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:11.091973 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:11.092035 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.092134 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.092153 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 21:05:11.094137 9545 raft_consensus.cc:1261] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 1 FOLLOWER]: Refusing update from remote peer 8048a15554744b5a816542ca3e9d3357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:11.094137 9322 raft_consensus.cc:1261] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 1 FOLLOWER]: Refusing update from remote peer 8048a15554744b5a816542ca3e9d3357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:11.094539 9677 consensus_queue.cc:1035] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9577d965a440412ebd5906cae4ec965d" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:11.094703 9681 consensus_queue.cc:1035] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "037df660bc7e4ba4969173c833d81fc2" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 43599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:11.096992 9687 mvcc.cc:205] Tried to move back new op lower bound from 7316369863038926848 to 7316369862855491584. Current Snapshot: MvccSnapshot[applied={T|T < 7316369863038926848}]
I20260808 21:05:11.097285 9686 mvcc.cc:205] Tried to move back new op lower bound from 7316369863038926848 to 7316369862855491584. Current Snapshot: MvccSnapshot[applied={T|T < 7316369863038926848}]
I20260808 21:05:11.099931 8861 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:11.100013 8861 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:11.100816 8861 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b82d4932f7c24edb90d3efc8bcd490d1: Sending DeleteTablet for 3 replicas of tablet 948ed97b7761445d8dd56af1002f4da3
I20260808 21:05:11.101135 9509 tablet_service.cc:1514] Processing DeleteTablet for tablet 948ed97b7761445d8dd56af1002f4da3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:11 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:44504
I20260808 21:05:11.101141 9289 tablet_service.cc:1514] Processing DeleteTablet for tablet 948ed97b7761445d8dd56af1002f4da3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:11 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:51208
I20260808 21:05:11.101217 9069 tablet_service.cc:1514] Processing DeleteTablet for tablet 948ed97b7761445d8dd56af1002f4da3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:11 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:48602
I20260808 21:05:11.101346 9702 tablet_replica.cc:330] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: stopping tablet replica
I20260808 21:05:11.101467 9702 raft_consensus.cc:2229] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:11.101472 9704 tablet_replica.cc:330] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357: stopping tablet replica
I20260808 21:05:11.101567 9704 raft_consensus.cc:2229] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:05:11.101588 9703 tablet_replica.cc:330] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: stopping tablet replica
I20260808 21:05:11.101666 9703 raft_consensus.cc:2229] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:11.101735 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 8972
I20260808 21:05:11.101789 9704 raft_consensus.cc:2258] T 948ed97b7761445d8dd56af1002f4da3 P 8048a15554744b5a816542ca3e9d3357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:11.101796 9703 raft_consensus.cc:2258] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:11.110220 9703 ts_tablet_manager.cc:1905] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:11.110767 9702 raft_consensus.cc:2258] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:11.111302 9702 ts_tablet_manager.cc:1905] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:11.111959 9703 ts_tablet_manager.cc:1918] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:11.112053 9703 log.cc:1196] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/948ed97b7761445d8dd56af1002f4da3
I20260808 21:05:11.112351 9703 ts_tablet_manager.cc:1939] T 948ed97b7761445d8dd56af1002f4da3 P 9577d965a440412ebd5906cae4ec965d: Deleting consensus metadata
I20260808 21:05:11.112795 8841 catalog_manager.cc:4841] TS 9577d965a440412ebd5906cae4ec965d (127.14.146.195:37269): tablet 948ed97b7761445d8dd56af1002f4da3 (table test-table [id=8dfaf6fc9f054d77b59939240892661a]) successfully deleted
I20260808 21:05:11.113301 9702 ts_tablet_manager.cc:1918] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:11.113384 9702 log.cc:1196] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/948ed97b7761445d8dd56af1002f4da3
I20260808 21:05:11.113626 9702 ts_tablet_manager.cc:1939] T 948ed97b7761445d8dd56af1002f4da3 P 037df660bc7e4ba4969173c833d81fc2: Deleting consensus metadata
I20260808 21:05:11.114078 8842 catalog_manager.cc:4841] TS 037df660bc7e4ba4969173c833d81fc2 (127.14.146.194:43599): tablet 948ed97b7761445d8dd56af1002f4da3 (table test-table [id=8dfaf6fc9f054d77b59939240892661a]) successfully deleted
W20260808 21:05:11.115234 8843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:45063 (error 108)
I20260808 21:05:11.115741 9653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.115623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:45063 (local address 127.0.0.1:48618)
0808 21:05:11.115674 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.115715 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:45063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 21:05:11.115871 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 9188
W20260808 21:05:11.115921 8843 catalog_manager.cc:4584] TS 8048a15554744b5a816542ca3e9d3357 (127.14.146.193:45063): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 948ed97b7761445d8dd56af1002f4da3: Network error: Client connection negotiation failed: client connection to 127.14.146.193:45063: connect: Connection refused (error 111)
I20260808 21:05:11.134001 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 9412
I20260808 21:05:11.144619 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 8812
2026-08-08T21:05:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2432 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T21:05:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:11Z Disabled control of system clock
I20260808 21:05:11.177089 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:37879
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:37879
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 21:05:11.260206 9723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:11.260435 9723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:11.260461 9723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:11.261628 9723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:11.261674 9723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:11.261688 9723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:11.261700 9723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:11.261713 9723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:11.262969 9723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:37879
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:37879
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:11.263170 9723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:11.263403 9723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:11.268298 9731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:11.268327 9734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:11.268294 9732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:11.268939 9723 server_base.cc:1034] running on GCE node
I20260808 21:05:11.269304 9723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:11.269718 9723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:11.270891 9723 hybrid_clock.cc:648] HybridClock initialized: now 1786223111270873 us; error 36 us; skew 500 ppm
I20260808 21:05:11.272341 9723 webserver.cc:460] Webserver started at http://127.14.146.254:37083/ using document root <none> and password file <none>
I20260808 21:05:11.272622 9723 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:11.272696 9723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:11.272858 9723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:11.274314 9723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "72356ce389914da0b0ca96ff4cf0824d"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "e4e5802d7e8742fda5383c5ec2b98ca2"
server_key_iv: "7fc681b41e4d5da16d8520f17c7fcf77"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.274773 9723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "72356ce389914da0b0ca96ff4cf0824d"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "e4e5802d7e8742fda5383c5ec2b98ca2"
server_key_iv: "7fc681b41e4d5da16d8520f17c7fcf77"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.278052 9723 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 21:05:11.279613 9740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.279814 9723 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:11.279917 9723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "72356ce389914da0b0ca96ff4cf0824d"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "e4e5802d7e8742fda5383c5ec2b98ca2"
server_key_iv: "7fc681b41e4d5da16d8520f17c7fcf77"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.280000 9723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:11.289685 9723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:11.289969 9723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:11.290120 9723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:11.294059 9723 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:37879
I20260808 21:05:11.294092 9831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:37879 every 8 connection(s)
I20260808 21:05:11.294440 9723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:11.295425 9832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:11.298635 9832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d: Bootstrap starting.
I20260808 21:05:11.299245 9832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:11.299543 9832 log.cc:824] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:11.300272 9832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d: No bootstrap required, opened a new log
I20260808 21:05:11.301714 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 9723
I20260808 21:05:11.301790 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:11.301965 14923 external_mini_cluster.cc:1428] Setting key cecfaa0754ad68d78f121674e893a688
I20260808 21:05:11.301954 9832 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72356ce389914da0b0ca96ff4cf0824d" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37879 } }
I20260808 21:05:11.302156 9832 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:11.302213 9832 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72356ce389914da0b0ca96ff4cf0824d, State: Initialized, Role: FOLLOWER
I20260808 21:05:11.302369 9832 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72356ce389914da0b0ca96ff4cf0824d" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37879 } }
I20260808 21:05:11.302470 9832 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:11.302505 9832 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:11.302583 9832 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:11.303162 9832 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72356ce389914da0b0ca96ff4cf0824d" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37879 } }
I20260808 21:05:11.303282 9832 leader_election.cc:302] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72356ce389914da0b0ca96ff4cf0824d; no voters:
I20260808 21:05:11.303469 9832 leader_election.cc:288] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:11.303503 9843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:11.303619 9843 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [term 1 LEADER]: Becoming Leader. State: Replica: 72356ce389914da0b0ca96ff4cf0824d, State: Running, Role: LEADER
I20260808 21:05:11.303766 9843 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72356ce389914da0b0ca96ff4cf0824d" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37879 } }
I20260808 21:05:11.303771 9832 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:11.305018 9846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72356ce389914da0b0ca96ff4cf0824d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72356ce389914da0b0ca96ff4cf0824d" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37879 } } }
I20260808 21:05:11.305132 9846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:11.305454 9847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72356ce389914da0b0ca96ff4cf0824d. Latest consensus state: current_term: 1 leader_uuid: "72356ce389914da0b0ca96ff4cf0824d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72356ce389914da0b0ca96ff4cf0824d" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 37879 } } }
I20260808 21:05:11.305790 9847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d [sys.catalog]: This master's current role is: LEADER
W20260808 21:05:11.305900 9869 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:05:11.305958 9869 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:05:11.306048 9867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:11.306246 9867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:11.307693 9867 catalog_manager.cc:1347] Generated new cluster ID: deaa9907c5ef4a82aa8a51002160ac85
I20260808 21:05:11.307753 9867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:11.308413 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.302611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57018 (local address 127.14.146.254:37879)
0808 21:05:11.302810 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.302817 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.302839 (+ 22us) server_negotiation.cc:407] Connection header received
0808 21:05:11.302941 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.302946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.303010 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.303112 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:11.303372 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.305136 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.306270 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.306721 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.306853 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.307574 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:11.307578 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:11.307578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:11.307805 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:11.307848 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:11.307863 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:11.307927 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.308128 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.308201 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
I20260808 21:05:11.321578 9867 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:11.322319 9867 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:11.327356 9867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d: Generated new TSK 0
I20260808 21:05:11.327559 9867 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:11.333597 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37879
--builtin_ntp_servers=127.14.146.212:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 21:05:11.419960 9876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:11.420210 9876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:11.420234 9876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:11.421475 9876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:11.421519 9876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:11.421546 9876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:05:11.423002 9876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:11.423261 9876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:11.423578 9876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:11.429379 9892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:11.429391 9884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:11.429400 9887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:11.429742 9876 server_base.cc:1034] running on GCE node
I20260808 21:05:11.429962 9876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:11.430219 9876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:11.431393 9876 hybrid_clock.cc:648] HybridClock initialized: now 1786223111431381 us; error 28 us; skew 500 ppm
I20260808 21:05:11.432873 9876 webserver.cc:460] Webserver started at http://127.14.146.193:36169/ using document root <none> and password file <none>
I20260808 21:05:11.433100 9876 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:11.433145 9876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:11.433238 9876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:11.434239 9876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "750491bb5faa4fc9bb8103da6fbafdfb"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "f3a4ef853f870d8e4d2d84f1bf22f889"
server_key_iv: "71e142e88dfd87284e7911484bc52871"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.434540 9876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "750491bb5faa4fc9bb8103da6fbafdfb"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "f3a4ef853f870d8e4d2d84f1bf22f889"
server_key_iv: "71e142e88dfd87284e7911484bc52871"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.435791 9876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:11.436566 9907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.436750 9876 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.436856 9876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "750491bb5faa4fc9bb8103da6fbafdfb"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "f3a4ef853f870d8e4d2d84f1bf22f889"
server_key_iv: "71e142e88dfd87284e7911484bc52871"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.436941 9876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:11.457499 9876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:11.457949 9876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:11.458115 9876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:11.458374 9876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:11.458719 9876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:11.458773 9876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.458809 9876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:11.458858 9876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.464728 9876 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:46795
I20260808 21:05:11.464781 10098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:46795 every 8 connection(s)
I20260808 21:05:11.465111 9876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:05:11.469601 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 9876
I20260808 21:05:11.469741 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:05:11.469944 14923 external_mini_cluster.cc:1428] Setting key d98ec5af15ad27a46707aedb9508d2a3
I20260808 21:05:11.470371 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.465869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:41679 (local address 127.14.146.254:37879)
0808 21:05:11.465934 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.465936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.466175 (+ 239us) server_negotiation.cc:407] Connection header received
0808 21:05:11.466649 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.466650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.466662 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.466715 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:11.467415 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.467910 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.468868 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.469060 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.469113 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.470031 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:11.470032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:11.470033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:11.470037 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:11.470054 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:11.470059 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:11.470118 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.470230 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.470266 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 21:05:11.470575 10102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.465873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37879 (local address 127.14.146.193:41679)
0808 21:05:11.466050 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.466083 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.466554 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.466806 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.466809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.466817 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:11.467330 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.467334 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.467985 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.467985 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.468798 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.468800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.469136 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.469136 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.469245 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.469852 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:11.469853 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:11.469895 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:11.469924 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:11.470132 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:11.470139 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:11.470142 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.470219 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.470339 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260808 21:05:11.471009 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37879
--builtin_ntp_servers=127.14.146.212:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 21:05:11.471315 10099 heartbeater.cc:347] Connected to a master server at 127.14.146.254:37879
I20260808 21:05:11.471412 10099 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:11.471608 10099 heartbeater.cc:511] Master 127.14.146.254:37879 requested a full tablet report, sending...
I20260808 21:05:11.472190 9772 ts_manager.cc:194] Registered new tserver with Master: 750491bb5faa4fc9bb8103da6fbafdfb (127.14.146.193:46795)
I20260808 21:05:11.472890 9772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.193:41679
W20260808 21:05:11.556015 10103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:11.556257 10103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:11.556279 10103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:11.557502 10103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:11.557554 10103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:11.557578 10103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:05:11.558955 10103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:11.559222 10103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:11.559540 10103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:11.564831 10116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:11.564821 10121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:11.564823 10113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:11.565074 10103 server_base.cc:1034] running on GCE node
I20260808 21:05:11.565294 10103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:11.565490 10103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:11.566669 10103 hybrid_clock.cc:648] HybridClock initialized: now 1786223111566659 us; error 28 us; skew 500 ppm
I20260808 21:05:11.568001 10103 webserver.cc:460] Webserver started at http://127.14.146.194:45303/ using document root <none> and password file <none>
I20260808 21:05:11.568295 10103 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:11.568372 10103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:11.568528 10103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:11.569609 10103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "e7c8e1512dfd430b9305b3e01980020e"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "1c8cf6adceb4846b0668ab8de150d9aa"
server_key_iv: "d3234add83d769e3369355fe614875f7"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.569986 10103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "e7c8e1512dfd430b9305b3e01980020e"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "1c8cf6adceb4846b0668ab8de150d9aa"
server_key_iv: "d3234add83d769e3369355fe614875f7"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.571332 10103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:11.572117 10130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.572311 10103 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:05:11.572414 10103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "e7c8e1512dfd430b9305b3e01980020e"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "1c8cf6adceb4846b0668ab8de150d9aa"
server_key_iv: "d3234add83d769e3369355fe614875f7"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.572500 10103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:11.596186 10103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:11.596549 10103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:11.596720 10103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:11.596982 10103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:11.597352 10103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:11.597388 10103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.597410 10103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:11.597424 10103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.603338 10103 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:36157
I20260808 21:05:11.603412 10328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:36157 every 8 connection(s)
I20260808 21:05:11.603760 10103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:05:11.607324 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 10103
I20260808 21:05:11.607431 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:05:11.607617 14923 external_mini_cluster.cc:1428] Setting key 36a6dc87e49eae412c4281a7cb7af380
I20260808 21:05:11.608668 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37879
--builtin_ntp_servers=127.14.146.212:35121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 21:05:11.609557 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.604615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:37345 (local address 127.14.146.254:37879)
0808 21:05:11.604721 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.604723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.604944 (+ 221us) server_negotiation.cc:407] Connection header received
0808 21:05:11.605492 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.605493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.605506 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.605556 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:11.606293 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.606809 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.608002 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.608296 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.608371 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.609281 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:11.609282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:11.609282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:11.609287 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:11.609301 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:11.609306 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:11.609355 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.609452 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.609481 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 21:05:11.609791 10336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.604599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37879 (local address 127.14.146.194:37345)
0808 21:05:11.604817 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.604851 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.605377 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.605649 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.605652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.605661 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:11.606193 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.606197 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.606915 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.606917 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.607915 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.607919 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.608392 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.608393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.608539 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.609130 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:11.609130 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:11.609161 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:11.609185 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:11.609354 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:11.609360 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:11.609363 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.609454 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.609558 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":99,"threads_started":1}
I20260808 21:05:11.610381 10331 heartbeater.cc:347] Connected to a master server at 127.14.146.254:37879
I20260808 21:05:11.610498 10331 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:11.610723 10331 heartbeater.cc:511] Master 127.14.146.254:37879 requested a full tablet report, sending...
I20260808 21:05:11.611099 9772 ts_manager.cc:194] Registered new tserver with Master: e7c8e1512dfd430b9305b3e01980020e (127.14.146.194:36157)
I20260808 21:05:11.611495 9772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.194:37345
W20260808 21:05:11.693271 10338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:11.693480 10338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:11.693501 10338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:11.694729 10338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:11.694772 10338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:11.694797 10338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:05:11.696264 10338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:35121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:37879
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:11.696511 10338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:11.696811 10338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:11.701853 10351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:11.701910 10349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:11.701931 10348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:11.702047 10338 server_base.cc:1034] running on GCE node
I20260808 21:05:11.702311 10338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:11.702590 10338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:11.703779 10338 hybrid_clock.cc:648] HybridClock initialized: now 1786223111703762 us; error 26 us; skew 500 ppm
I20260808 21:05:11.705335 10338 webserver.cc:460] Webserver started at http://127.14.146.195:38207/ using document root <none> and password file <none>
I20260808 21:05:11.705595 10338 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:11.705677 10338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:11.705818 10338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:11.706882 10338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "f5da864aaf334739b2441a766581062b"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "1c7ecfa7e482077b0bf60709ce123284"
server_key_iv: "61599dd607f6b2258d9ecb658c7cca36"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.707258 10338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "f5da864aaf334739b2441a766581062b"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "1c7ecfa7e482077b0bf60709ce123284"
server_key_iv: "61599dd607f6b2258d9ecb658c7cca36"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.708675 10338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:11.709400 10369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.709578 10338 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:11.709695 10338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "f5da864aaf334739b2441a766581062b"
format_stamp: "Formatted at 2026-08-08 21:05:11 on dist-test-slave-t3q3"
server_key: "1c7ecfa7e482077b0bf60709ce123284"
server_key_iv: "61599dd607f6b2258d9ecb658c7cca36"
server_key_version: "encryptionkey@0"
I20260808 21:05:11.709771 10338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:11.721944 10338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:11.722221 10338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:11.722374 10338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:11.722597 10338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:11.722915 10338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:11.722968 10338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.723008 10338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:11.723037 10338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:11.729027 10338 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:42527
I20260808 21:05:11.729082 10572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:42527 every 8 connection(s)
I20260808 21:05:11.729396 10338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:05:11.734157 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.730053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:49023 (local address 127.14.146.254:37879)
0808 21:05:11.730140 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.730142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.730340 (+ 198us) server_negotiation.cc:407] Connection header received
0808 21:05:11.730774 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.730775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.730784 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.730836 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:11.731449 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.731936 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.732930 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.733122 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.733175 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.733930 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:11.733931 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:11.733931 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:11.733936 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:11.733949 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:11.733953 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:11.733996 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.734076 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.734101 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 21:05:11.734331 10575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.730023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:37879 (local address 127.14.146.195:49023)
0808 21:05:11.730228 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.730259 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.730691 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.730887 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.730890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.730898 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:11.731379 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.731382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.732016 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.732017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.732855 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.732857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.733200 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.733201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.733306 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.733803 (+ 497us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:11.733803 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:11.733830 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:11.733851 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:11.734008 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:11.734012 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:11.734014 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.734064 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.734145 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
I20260808 21:05:11.734822 10573 heartbeater.cc:347] Connected to a master server at 127.14.146.254:37879
I20260808 21:05:11.735021 10573 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:11.735194 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 10338
I20260808 21:05:11.735227 10573 heartbeater.cc:511] Master 127.14.146.254:37879 requested a full tablet report, sending...
I20260808 21:05:11.735307 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:05:11.735526 14923 external_mini_cluster.cc:1428] Setting key 3654e58dcea82d5121dc2d23e43818ae
I20260808 21:05:11.735638 9772 ts_manager.cc:194] Registered new tserver with Master: f5da864aaf334739b2441a766581062b (127.14.146.195:42527)
I20260808 21:05:11.736159 9772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.195:49023
I20260808 21:05:11.736464 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:05:11.740653 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.737748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57022 (local address 127.14.146.254:37879)
0808 21:05:11.737805 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.737807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.737936 (+ 129us) server_negotiation.cc:407] Connection header received
0808 21:05:11.738012 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.738013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.738024 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.738079 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:11.738259 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.738697 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.739524 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.739732 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.739811 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.740437 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:11.740438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:11.740438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:11.740442 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:11.740453 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:11.740457 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:11.740506 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.740540 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.740560 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:05:11.742121 9770 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:05:11.743523 9770 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:05:11.749645 10587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.745508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:36157 (local address 127.0.0.1:53040)
0808 21:05:11.745715 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.745753 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.745824 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.746363 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.746364 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.746366 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:11.746422 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.746424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.747316 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.747317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.748549 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.748551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.749347 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.749348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.749426 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.749440 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.749512 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.749560 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":64,"threads_started":1}
I20260808 21:05:11.749644 10589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.745599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53040 (local address 127.14.146.194:36157)
0808 21:05:11.746205 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.746209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.746218 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:11.746248 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.746268 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.746284 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.746362 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:11.746507 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.747228 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.748635 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.749248 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.749335 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.749421 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.749525 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.749562 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":96,"threads_started":1}
I20260808 21:05:11.749868 10585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.745554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:42527 (local address 127.0.0.1:41052)
0808 21:05:11.745783 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.745792 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.745834 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.746122 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.746125 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.746127 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:11.746189 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.746192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.747611 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.747612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.748661 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.748663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.749644 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.749645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.749708 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.749712 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.749759 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.749798 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":101,"threads_started":1}
I20260808 21:05:11.750054 10588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.745555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:46795 (local address 127.0.0.1:52576)
0808 21:05:11.745924 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.745932 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.745970 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.746352 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.746353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.746355 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:11.746395 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.746397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.747792 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.747793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.748812 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.748815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.749679 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.749680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.749902 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.749907 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.749946 (+ 39us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.749991 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":3,"spinlock_wait_cycles":384,"thread_start_us":103,"threads_started":1}
I20260808 21:05:11.750161 10591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.745798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41052 (local address 127.14.146.195:42527)
0808 21:05:11.745943 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.745947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.745959 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:05:11.745993 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.745995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.746011 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.746099 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:11.746443 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.747524 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.748752 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.749454 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.749528 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.749604 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.750028 (+ 424us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.750067 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":90,"threads_started":1}
I20260808 21:05:11.750545 10210 tablet_service.cc:1467] Processing CreateTablet for tablet 77f3b1b88670458ea7107afadc5571a2 (DEFAULT_TABLE table=test-table [id=33c2dfcb8a6d4430a505c7f2950af608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:11.750821 10592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.745966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52576 (local address 127.14.146.193:46795)
0808 21:05:11.746179 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.746184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.746194 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:11.746230 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.746232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.746249 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.746617 (+ 368us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:11.746678 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.747704 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.748900 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.749589 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.750566 (+ 977us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.750655 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.750680 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.750734 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":100,"threads_started":1}
I20260808 21:05:11.750792 10459 tablet_service.cc:1467] Processing CreateTablet for tablet 77f3b1b88670458ea7107afadc5571a2 (DEFAULT_TABLE table=test-table [id=33c2dfcb8a6d4430a505c7f2950af608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:11.750950 10210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f3b1b88670458ea7107afadc5571a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:11.751122 10459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f3b1b88670458ea7107afadc5571a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:11.751451 9986 tablet_service.cc:1467] Processing CreateTablet for tablet 77f3b1b88670458ea7107afadc5571a2 (DEFAULT_TABLE table=test-table [id=33c2dfcb8a6d4430a505c7f2950af608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:11.751771 9986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f3b1b88670458ea7107afadc5571a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:11.754417 10594 tablet_bootstrap.cc:492] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: Bootstrap starting.
I20260808 21:05:11.754998 10594 tablet_bootstrap.cc:654] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:11.754984 10597 tablet_bootstrap.cc:492] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb: Bootstrap starting.
I20260808 21:05:11.755095 10593 tablet_bootstrap.cc:492] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: Bootstrap starting.
I20260808 21:05:11.755364 10594 log.cc:824] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:11.755640 10597 tablet_bootstrap.cc:654] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:11.755795 10593 tablet_bootstrap.cc:654] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:11.755972 10597 log.cc:824] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:11.756174 10594 tablet_bootstrap.cc:492] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: No bootstrap required, opened a new log
I20260808 21:05:11.756187 10593 log.cc:824] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:11.756258 10594 ts_tablet_manager.cc:1397] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:05:11.756882 10597 tablet_bootstrap.cc:492] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb: No bootstrap required, opened a new log
I20260808 21:05:11.756880 10593 tablet_bootstrap.cc:492] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: No bootstrap required, opened a new log
I20260808 21:05:11.756949 10593 ts_tablet_manager.cc:1397] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:05:11.757009 10597 ts_tablet_manager.cc:1397] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:11.758279 10594 raft_consensus.cc:348] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.758391 10594 raft_consensus.cc:374] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:11.758411 10594 raft_consensus.cc:729] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5da864aaf334739b2441a766581062b, State: Initialized, Role: FOLLOWER
I20260808 21:05:11.758525 10594 consensus_queue.cc:260] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.758805 10573 heartbeater.cc:503] Master 127.14.146.254:37879 was elected leader, sending a full tablet report...
I20260808 21:05:11.758790 10594 ts_tablet_manager.cc:1428] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 21:05:11.759472 10593 raft_consensus.cc:348] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.759472 10597 raft_consensus.cc:348] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.759616 10597 raft_consensus.cc:374] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:11.759616 10593 raft_consensus.cc:374] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:11.759653 10597 raft_consensus.cc:729] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 750491bb5faa4fc9bb8103da6fbafdfb, State: Initialized, Role: FOLLOWER
I20260808 21:05:11.759653 10593 raft_consensus.cc:729] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c8e1512dfd430b9305b3e01980020e, State: Initialized, Role: FOLLOWER
I20260808 21:05:11.759765 10593 consensus_queue.cc:260] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.759765 10597 consensus_queue.cc:260] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.760012 10597 ts_tablet_manager.cc:1428] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:05:11.760012 10593 ts_tablet_manager.cc:1428] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:05:11.760085 10331 heartbeater.cc:503] Master 127.14.146.254:37879 was elected leader, sending a full tablet report...
I20260808 21:05:11.760371 10099 heartbeater.cc:503] Master 127.14.146.254:37879 was elected leader, sending a full tablet report...
I20260808 21:05:11.790868 10604 raft_consensus.cc:482] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:05:11.791034 10604 raft_consensus.cc:504] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.791425 10604 leader_election.cc:288] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c8e1512dfd430b9305b3e01980020e (127.14.146.194:36157), 750491bb5faa4fc9bb8103da6fbafdfb (127.14.146.193:46795)
I20260808 21:05:11.794440 10592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.791701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:48811 (local address 127.14.146.193:46795)
0808 21:05:11.791754 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.791756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.791950 (+ 194us) server_negotiation.cc:407] Connection header received
0808 21:05:11.791984 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.791985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.792001 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.792107 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:11.792276 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.792746 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.793718 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.794084 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.794172 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.794181 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.794330 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.794370 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 21:05:11.794440 10589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.791690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:53199 (local address 127.14.146.194:36157)
0808 21:05:11.791739 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.791741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.791751 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:11.791783 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.791785 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.791794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.791865 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:11.792173 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.792686 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.793712 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.794080 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.794172 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.794181 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.794318 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.794363 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:05:11.794478 10575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.791605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:36157 (local address 127.14.146.195:53199)
0808 21:05:11.791665 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.791677 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.791723 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.791931 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.791933 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.791935 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:11.792020 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.792022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.792767 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.792768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.793606 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.793608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.794162 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.794164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.794241 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.794244 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.794313 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.794365 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":39}
I20260808 21:05:11.794500 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.791605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:46795 (local address 127.14.146.195:48811)
0808 21:05:11.791845 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.791856 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:11.791917 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:11.792119 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:11.792120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:11.792121 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:11.792196 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.792197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.792852 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.792853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.793614 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:11.793616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.794171 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.794172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:11.794251 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.794254 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:11.794322 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 21:05:11.794367 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":14,"thread_start_us":130,"threads_started":1}
I20260808 21:05:11.794821 10238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f3b1b88670458ea7107afadc5571a2" candidate_uuid: "f5da864aaf334739b2441a766581062b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c8e1512dfd430b9305b3e01980020e" is_pre_election: true
I20260808 21:05:11.794996 10238 raft_consensus.cc:2454] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5da864aaf334739b2441a766581062b in term 0.
I20260808 21:05:11.794992 10024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f3b1b88670458ea7107afadc5571a2" candidate_uuid: "f5da864aaf334739b2441a766581062b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" is_pre_election: true
I20260808 21:05:11.795112 10024 raft_consensus.cc:2454] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5da864aaf334739b2441a766581062b in term 0.
I20260808 21:05:11.795362 10371 leader_election.cc:302] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 750491bb5faa4fc9bb8103da6fbafdfb, f5da864aaf334739b2441a766581062b; no voters:
I20260808 21:05:11.795542 10604 raft_consensus.cc:2781] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:05:11.795622 10604 raft_consensus.cc:482] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:05:11.795653 10604 raft_consensus.cc:3037] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:11.796397 10604 raft_consensus.cc:504] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.796547 10604 leader_election.cc:288] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [CANDIDATE]: Term 1 election: Requested vote from peers e7c8e1512dfd430b9305b3e01980020e (127.14.146.194:36157), 750491bb5faa4fc9bb8103da6fbafdfb (127.14.146.193:46795)
I20260808 21:05:11.796698 10238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f3b1b88670458ea7107afadc5571a2" candidate_uuid: "f5da864aaf334739b2441a766581062b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c8e1512dfd430b9305b3e01980020e"
I20260808 21:05:11.796715 10024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f3b1b88670458ea7107afadc5571a2" candidate_uuid: "f5da864aaf334739b2441a766581062b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "750491bb5faa4fc9bb8103da6fbafdfb"
I20260808 21:05:11.796782 10238 raft_consensus.cc:3037] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:11.796801 10024 raft_consensus.cc:3037] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:11.797502 10238 raft_consensus.cc:2454] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5da864aaf334739b2441a766581062b in term 1.
I20260808 21:05:11.797502 10024 raft_consensus.cc:2454] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5da864aaf334739b2441a766581062b in term 1.
I20260808 21:05:11.797685 10380 leader_election.cc:302] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7c8e1512dfd430b9305b3e01980020e, f5da864aaf334739b2441a766581062b; no voters:
I20260808 21:05:11.797791 10604 raft_consensus.cc:2781] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:11.797950 10604 raft_consensus.cc:686] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 1 LEADER]: Becoming Leader. State: Replica: f5da864aaf334739b2441a766581062b, State: Running, Role: LEADER
I20260808 21:05:11.798059 10604 consensus_queue.cc:237] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } }
I20260808 21:05:11.798866 9770 catalog_manager.cc:5495] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b reported cstate change: term changed from 0 to 1, leader changed from <none> to f5da864aaf334739b2441a766581062b (127.14.146.195). New cstate: current_term: 1 leader_uuid: "f5da864aaf334739b2441a766581062b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5da864aaf334739b2441a766581062b" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260808 21:05:11.806917 10591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.804510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41066 (local address 127.14.146.195:42527)
0808 21:05:11.804572 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:11.804574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:11.804582 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:05:11.804613 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:11.804614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:11.804630 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:11.804726 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:11.804878 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.805367 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.806121 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:11.806335 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:11.806413 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:11.806589 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:11.806693 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:11.806790 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:11.806812 (+ 22us) server_negotiation.cc:299] Negotiation successful
0808 21:05:11.806829 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:05:11.808706 10024 raft_consensus.cc:1261] T 77f3b1b88670458ea7107afadc5571a2 P 750491bb5faa4fc9bb8103da6fbafdfb [term 1 FOLLOWER]: Refusing update from remote peer f5da864aaf334739b2441a766581062b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:11.808768 10238 raft_consensus.cc:1261] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 1 FOLLOWER]: Refusing update from remote peer f5da864aaf334739b2441a766581062b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:11.809049 10610 consensus_queue.cc:1035] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "750491bb5faa4fc9bb8103da6fbafdfb" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:11.809152 10604 consensus_queue.cc:1035] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c8e1512dfd430b9305b3e01980020e" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:11.811406 10615 mvcc.cc:205] Tried to move back new op lower bound from 7316369865965572096 to 7316369865925558272. Current Snapshot: MvccSnapshot[applied={T|T < 7316369865965572096}]
I20260808 21:05:11.812000 10616 mvcc.cc:205] Tried to move back new op lower bound from 7316369865965572096 to 7316369865925558272. Current Snapshot: MvccSnapshot[applied={T|T < 7316369865965572096}]
I20260808 21:05:11.812263 10618 mvcc.cc:205] Tried to move back new op lower bound from 7316369865965572096 to 7316369865925558272. Current Snapshot: MvccSnapshot[applied={T|T < 7316369865965572096}]
I20260808 21:05:11.813541 9772 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:11.813624 9772 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:11.814349 9772 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72356ce389914da0b0ca96ff4cf0824d: Sending DeleteTablet for 3 replicas of tablet 77f3b1b88670458ea7107afadc5571a2
I20260808 21:05:11.814699 10459 tablet_service.cc:1514] Processing DeleteTablet for tablet 77f3b1b88670458ea7107afadc5571a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:11 UTC) from {username='slave'} at 127.0.0.1:41052
I20260808 21:05:11.814723 10210 tablet_service.cc:1514] Processing DeleteTablet for tablet 77f3b1b88670458ea7107afadc5571a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:11 UTC) from {username='slave'} at 127.0.0.1:53040
I20260808 21:05:11.814715 9986 tablet_service.cc:1514] Processing DeleteTablet for tablet 77f3b1b88670458ea7107afadc5571a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:11 UTC) from {username='slave'} at 127.0.0.1:52576
I20260808 21:05:11.814960 10629 tablet_replica.cc:330] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: stopping tablet replica
I20260808 21:05:11.814965 10628 tablet_replica.cc:330] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: stopping tablet replica
I20260808 21:05:11.815056 10628 raft_consensus.cc:2229] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:05:11.815128 10629 raft_consensus.cc:2229] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:11.815251 10629 raft_consensus.cc:2258] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:11.815276 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 9876
I20260808 21:05:11.815328 10628 raft_consensus.cc:2258] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:11.816133 10628 ts_tablet_manager.cc:1905] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:11.817818 10628 ts_tablet_manager.cc:1918] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:11.817888 10628 log.cc:1196] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/77f3b1b88670458ea7107afadc5571a2
I20260808 21:05:11.818140 10628 ts_tablet_manager.cc:1939] T 77f3b1b88670458ea7107afadc5571a2 P f5da864aaf334739b2441a766581062b: Deleting consensus metadata
I20260808 21:05:11.818567 9743 catalog_manager.cc:4841] TS f5da864aaf334739b2441a766581062b (127.14.146.195:42527): tablet 77f3b1b88670458ea7107afadc5571a2 (table test-table [id=33c2dfcb8a6d4430a505c7f2950af608]) successfully deleted
I20260808 21:05:11.822410 10629 ts_tablet_manager.cc:1905] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:11.823959 10629 ts_tablet_manager.cc:1918] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:11.824043 10629 log.cc:1196] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/77f3b1b88670458ea7107afadc5571a2
I20260808 21:05:11.824376 10629 ts_tablet_manager.cc:1939] T 77f3b1b88670458ea7107afadc5571a2 P e7c8e1512dfd430b9305b3e01980020e: Deleting consensus metadata
I20260808 21:05:11.824793 9745 catalog_manager.cc:4841] TS e7c8e1512dfd430b9305b3e01980020e (127.14.146.194:36157): tablet 77f3b1b88670458ea7107afadc5571a2 (table test-table [id=33c2dfcb8a6d4430a505c7f2950af608]) successfully deleted
W20260808 21:05:11.828019 9742 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:46795 (error 108)
I20260808 21:05:11.828234 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 10103
I20260808 21:05:11.828557 10588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:11.828420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:46795 (local address 127.0.0.1:52588)
0808 21:05:11.828469 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:11.828510 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:46795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 21:05:11.828722 9742 catalog_manager.cc:4584] TS 750491bb5faa4fc9bb8103da6fbafdfb (127.14.146.193:46795): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77f3b1b88670458ea7107afadc5571a2: Network error: Client connection negotiation failed: client connection to 127.14.146.193:46795: connect: Connection refused (error 111)
I20260808 21:05:11.838616 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 10338
I20260808 21:05:11.850649 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 9723
2026-08-08T21:05:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (707 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:11 dist-test-slave-t3q3 krb5kdc[10640](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:11 dist-test-slave-t3q3 krb5kdc[10640](info): set up 2 sockets
Aug 08 21:05:11 dist-test-slave-t3q3 krb5kdc[10640](info): commencing operation
krb5kdc: starting...
W20260808 21:05:13.092181 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:13.216318 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:46017
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:42993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:46017
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:13.303284 10661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:13.303599 10661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:13.303658 10661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:13.305483 10661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:13.305558 10661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:13.305588 10661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:13.305619 10661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:13.305650 10661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:13.307519 10661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:42993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:46017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:46017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:13.307840 10661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:13.308174 10661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:13.313663 10670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:13.313664 10675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:13.313699 10672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:13.313884 10661 server_base.cc:1034] running on GCE node
I20260808 21:05:13.314265 10661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:13.314574 10661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:13.315754 10661 hybrid_clock.cc:648] HybridClock initialized: now 1786223113315747 us; error 39 us; skew 500 ppm
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:13.318411 10661 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:13.318866 10661 webserver.cc:460] Webserver started at http://127.14.146.254:39349/ using document root <none> and password file <none>
I20260808 21:05:13.319109 10661 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:13.319182 10661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:13.319346 10661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:13.320505 10661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "ea15fdacbf8d4bca8c2f69514a968570"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "e7956b42d5386e044dac4c754154ff38"
server_key_iv: "e9405bcc15a981a25294c657c0626156"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.320894 10661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "ea15fdacbf8d4bca8c2f69514a968570"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "e7956b42d5386e044dac4c754154ff38"
server_key_iv: "e9405bcc15a981a25294c657c0626156"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.322346 10661 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 21:05:13.323140 10689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.323345 10661 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:13.323459 10661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "ea15fdacbf8d4bca8c2f69514a968570"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "e7956b42d5386e044dac4c754154ff38"
server_key_iv: "e9405bcc15a981a25294c657c0626156"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.323539 10661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:13.339068 10661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:13.341372 10661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:13.341545 10661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:13.345692 10661 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:46017
I20260808 21:05:13.345736 10770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:46017 every 8 connection(s)
I20260808 21:05:13.346119 10661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:13.347118 10772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:13.349442 10772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570: Bootstrap starting.
I20260808 21:05:13.349985 10772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:13.350237 10772 log.cc:824] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:13.350963 10772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570: No bootstrap required, opened a new log
I20260808 21:05:13.351087 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 10661
I20260808 21:05:13.351228 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:13.351428 14923 external_mini_cluster.cc:1428] Setting key cdbf4168ff12442e6786665f6b7ed512
I20260808 21:05:13.353307 10772 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15fdacbf8d4bca8c2f69514a968570" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46017 } }
I20260808 21:05:13.353503 10772 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:13.353557 10772 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea15fdacbf8d4bca8c2f69514a968570, State: Initialized, Role: FOLLOWER
I20260808 21:05:13.353703 10772 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15fdacbf8d4bca8c2f69514a968570" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46017 } }
I20260808 21:05:13.353797 10772 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:13.353837 10772 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:13.353889 10772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:13.354660 10772 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15fdacbf8d4bca8c2f69514a968570" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46017 } }
I20260808 21:05:13.354779 10772 leader_election.cc:302] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea15fdacbf8d4bca8c2f69514a968570; no voters:
I20260808 21:05:13.354952 10772 leader_election.cc:288] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:13.355033 10781 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:13.355201 10781 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [term 1 LEADER]: Becoming Leader. State: Replica: ea15fdacbf8d4bca8c2f69514a968570, State: Running, Role: LEADER
I20260808 21:05:13.355249 10772 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:13.355974 10781 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15fdacbf8d4bca8c2f69514a968570" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46017 } }
I20260808 21:05:13.356660 10787 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea15fdacbf8d4bca8c2f69514a968570" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15fdacbf8d4bca8c2f69514a968570" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46017 } } }
I20260808 21:05:13.356756 10787 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:13.357098 10784 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea15fdacbf8d4bca8c2f69514a968570. Latest consensus state: current_term: 1 leader_uuid: "ea15fdacbf8d4bca8c2f69514a968570" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea15fdacbf8d4bca8c2f69514a968570" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 46017 } } }
I20260808 21:05:13.357111 10805 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:13.357195 10784 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:13.357652 10805 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:13.359644 10805 catalog_manager.cc:1347] Generated new cluster ID: cedea4c09b164eb4bd610eb6c08835ab
I20260808 21:05:13.359702 10805 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:13.364776 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.351976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40358 (local address 127.14.146.254:46017)
0808 21:05:13.352191 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.352199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.352224 (+ 25us) server_negotiation.cc:407] Connection header received
0808 21:05:13.352809 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.352816 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.352862 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.352987 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:13.353885 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.355627 (+ 1742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.356776 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.357364 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.357457 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.360631 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:13.360635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:13.360636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:13.360648 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:13.362704 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.363139 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.363143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.363143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.363263 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.363497 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.363498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.363498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.363805 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:13.364353 (+ 548us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.364432 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.364572 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":123,"threads_started":1}
I20260808 21:05:13.372335 10805 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:13.373107 10805 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:13.379746 10805 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570: Generated new TSK 0
I20260808 21:05:13.379973 10805 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:05:13.407701 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46017
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:42993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:13.492396 10813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:13.492592 10813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:13.492617 10813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:13.493857 10813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:13.493902 10813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:13.493928 10813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:05:13.495368 10813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:42993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:13.495625 10813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:13.495853 10813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:13.500962 10823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:13.501027 10822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:13.501181 10813 server_base.cc:1034] running on GCE node
W20260808 21:05:13.500986 10826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:13.501422 10813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:13.501681 10813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:13.502851 10813 hybrid_clock.cc:648] HybridClock initialized: now 1786223113502845 us; error 37 us; skew 500 ppm
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:13.505520 10813 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:05:13.505985 10813 webserver.cc:460] Webserver started at http://127.14.146.193:33455/ using document root <none> and password file <none>
I20260808 21:05:13.506234 10813 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:13.506304 10813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:13.506464 10813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:13.507489 10813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "26059c4483a24c12b281da24acaa3fe4"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "92b90c50b5f3918ea86dd152c06c39ba"
server_key_iv: "907ad1d27ee7f5b3a64b64e780aec7cb"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.507858 10813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "26059c4483a24c12b281da24acaa3fe4"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "92b90c50b5f3918ea86dd152c06c39ba"
server_key_iv: "907ad1d27ee7f5b3a64b64e780aec7cb"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.509282 10813 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:13.510015 10837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.510214 10813 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:13.510316 10813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "26059c4483a24c12b281da24acaa3fe4"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "92b90c50b5f3918ea86dd152c06c39ba"
server_key_iv: "907ad1d27ee7f5b3a64b64e780aec7cb"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.510403 10813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:13.533972 10813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:13.535897 10813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:13.536135 10813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:13.536391 10813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:13.536715 10813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:13.536770 10813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.536814 10813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:13.536840 10813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.542724 10813 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:36219
I20260808 21:05:13.542773 11018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:36219 every 8 connection(s)
I20260808 21:05:13.543124 10813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:05:13.543944 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 10813
I20260808 21:05:13.544093 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:05:13.544306 14923 external_mini_cluster.cc:1428] Setting key b893267a9fd9bba48247fb78ea461390
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:13.553092 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.543899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:43731 (local address 127.14.146.254:46017)
0808 21:05:13.543971 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.543973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.544172 (+ 199us) server_negotiation.cc:407] Connection header received
0808 21:05:13.544869 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.544871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.544885 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.544933 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:13.545999 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.546527 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.547560 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.547779 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.547856 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.550112 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:13.550114 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:13.550122 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:13.550130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:13.551562 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.551977 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.551978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.551979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.552041 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.552391 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.552392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.552392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.552513 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:13.552588 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.552887 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.552987 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 21:05:13.553318 11022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.543813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:46017 (local address 127.14.146.193:43731)
0808 21:05:13.544019 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.544087 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:13.544755 (+ 668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:13.545029 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:13.545034 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:13.545691 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:13.545894 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.545899 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.546643 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.546644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.547466 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.547468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.547878 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.547879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.548020 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.548627 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:13.548636 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:13.550014 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:13.551654 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:13.551662 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:13.551664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:13.551896 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:13.552192 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:13.552193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:13.552193 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:13.552318 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:13.552591 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:13.552599 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:13.552748 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 21:05:13.552852 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 21:05:13.553034 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:05:13.553877 11019 heartbeater.cc:347] Connected to a master server at 127.14.146.254:46017
I20260808 21:05:13.553990 11019 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:13.554214 11019 heartbeater.cc:511] Master 127.14.146.254:46017 requested a full tablet report, sending...
I20260808 21:05:13.554837 10713 ts_manager.cc:194] Registered new tserver with Master: 26059c4483a24c12b281da24acaa3fe4 (127.14.146.193:36219)
I20260808 21:05:13.555596 10713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:43731
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:05:13.571570 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46017
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:42993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:13.654390 11025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:13.654593 11025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:13.654618 11025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:13.655850 11025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:13.655923 11025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:13.655953 11025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:05:13.657588 11025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:42993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:13.657783 11025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:13.657958 11025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:13.662984 11037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:13.662961 11033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:13.663174 11025 server_base.cc:1034] running on GCE node
W20260808 21:05:13.663165 11034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:13.663434 11025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:13.663719 11025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:13.664897 11025 hybrid_clock.cc:648] HybridClock initialized: now 1786223113664882 us; error 26 us; skew 500 ppm
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:13.667632 11025 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:05:13.668205 11025 webserver.cc:460] Webserver started at http://127.14.146.194:40385/ using document root <none> and password file <none>
I20260808 21:05:13.668463 11025 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:13.668535 11025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:13.668678 11025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:13.669721 11025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "02af3d18d827475fb90d193f90e158ac"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "acc901807264f39302a15700adab70c5"
server_key_iv: "df8ea8a884cdaf958005cf84106d1dee"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.670096 11025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "02af3d18d827475fb90d193f90e158ac"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "acc901807264f39302a15700adab70c5"
server_key_iv: "df8ea8a884cdaf958005cf84106d1dee"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.671476 11025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:13.672313 11046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.672506 11025 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:13.672619 11025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "02af3d18d827475fb90d193f90e158ac"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "acc901807264f39302a15700adab70c5"
server_key_iv: "df8ea8a884cdaf958005cf84106d1dee"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.672700 11025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:13.687695 11025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:13.689772 11025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:13.689944 11025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:13.690196 11025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:13.690518 11025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:13.690574 11025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.690611 11025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:13.690639 11025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.696571 11025 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:41369
I20260808 21:05:13.696633 11242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:41369 every 8 connection(s)
I20260808 21:05:13.696943 11025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:05:13.697252 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 11025
I20260808 21:05:13.697382 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:05:13.697630 14923 external_mini_cluster.cc:1428] Setting key 86e32baa584ed9b9288b7d2a87815aef
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:13.707407 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.697742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:37111 (local address 127.14.146.254:46017)
0808 21:05:13.697800 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.697803 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.698059 (+ 256us) server_negotiation.cc:407] Connection header received
0808 21:05:13.698635 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.698636 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.698649 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.698701 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:13.699698 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.700414 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.701450 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.701777 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.701856 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.704268 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:13.704270 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:13.704270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:13.704280 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:13.705882 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.706377 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.706379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.706379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.706441 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.706693 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.706694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.706695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.706853 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:13.706937 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.707218 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.707313 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:05:13.707479 11247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.697725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:46017 (local address 127.14.146.194:37111)
0808 21:05:13.697919 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.697969 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:13.698527 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:13.698775 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:13.698783 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:13.699363 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:13.699573 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.699578 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.700515 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.700525 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.701368 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.701370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.701902 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.701903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.702029 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.702607 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:13.702616 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:13.704174 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:13.705979 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:13.705986 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:13.705987 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:13.706278 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:13.706514 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:13.706515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:13.706515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:13.706617 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:13.706932 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:13.706937 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:13.707063 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 21:05:13.707163 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 21:05:13.707286 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
I20260808 21:05:13.708300 11244 heartbeater.cc:347] Connected to a master server at 127.14.146.254:46017
I20260808 21:05:13.708441 11244 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:13.708663 11244 heartbeater.cc:511] Master 127.14.146.254:46017 requested a full tablet report, sending...
I20260808 21:05:13.709054 10713 ts_manager.cc:194] Registered new tserver with Master: 02af3d18d827475fb90d193f90e158ac (127.14.146.194:41369)
I20260808 21:05:13.709434 10713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:37111
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:05:13.727075 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46017
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:42993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:13.811620 11254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:13.811837 11254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:13.811861 11254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:13.813159 11254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:13.813208 11254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:13.813234 11254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:05:13.814771 11254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:42993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:46017
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:13.815043 11254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:13.815290 11254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:13.821967 11267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:13.821990 11272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:13.821967 11268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:13.822346 11254 server_base.cc:1034] running on GCE node
I20260808 21:05:13.822549 11254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:13.822804 11254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:13.823956 11254 hybrid_clock.cc:648] HybridClock initialized: now 1786223113823928 us; error 42 us; skew 500 ppm
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:13.830015 11254 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:05:13.830462 11254 webserver.cc:460] Webserver started at http://127.14.146.195:46293/ using document root <none> and password file <none>
I20260808 21:05:13.830701 11254 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:13.830775 11254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:13.830929 11254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:13.832017 11254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "34e607ca7bea4173974fc99cac607305"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "d8c5bfc0b43617ee1a1dd849666895b7"
server_key_iv: "b9ba3cb82e9a7518f1a5aa8af7bb6c70"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.832456 11254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "34e607ca7bea4173974fc99cac607305"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "d8c5bfc0b43617ee1a1dd849666895b7"
server_key_iv: "b9ba3cb82e9a7518f1a5aa8af7bb6c70"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.833951 11254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 21:05:13.834784 11284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.835001 11254 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:13.835111 11254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "34e607ca7bea4173974fc99cac607305"
format_stamp: "Formatted at 2026-08-08 21:05:13 on dist-test-slave-t3q3"
server_key: "d8c5bfc0b43617ee1a1dd849666895b7"
server_key_iv: "b9ba3cb82e9a7518f1a5aa8af7bb6c70"
server_key_version: "encryptionkey@0"
I20260808 21:05:13.835196 11254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:13.848351 11254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:13.850912 11254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:13.851076 11254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:13.851338 11254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:13.851706 11254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:13.851763 11254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.851805 11254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:13.851840 11254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:13.858153 11254 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:41213
I20260808 21:05:13.858196 11469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:41213 every 8 connection(s)
I20260808 21:05:13.858559 11254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:05:13.863482 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 11254
I20260808 21:05:13.863600 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:05:13.863839 14923 external_mini_cluster.cc:1428] Setting key f2ef95ea9e1c3dc43037f2634c42bf9d
Aug 08 21:05:13 dist-test-slave-t3q3 krb5kdc[10640](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223113, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:13.868602 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.859331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:50719 (local address 127.14.146.254:46017)
0808 21:05:13.859388 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.859390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.859616 (+ 226us) server_negotiation.cc:407] Connection header received
0808 21:05:13.860131 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.860132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.860145 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.860222 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:13.861158 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.861669 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.862638 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.862875 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.862934 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.865621 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:13.865623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:13.865623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:13.865630 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:13.867160 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.867561 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.867562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.867563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.867631 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.867899 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.867901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.867901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.868032 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:13.868215 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.868461 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.868536 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 21:05:13.868904 11473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.859323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:46017 (local address 127.14.146.195:50719)
0808 21:05:13.859482 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.859524 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:13.860001 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:13.860282 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:13.860285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:13.860858 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:13.861060 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.861065 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.861747 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.861748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.862558 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.862560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.863015 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.863016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.863144 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.863900 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:13.863913 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:13.865516 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:13.867238 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:13.867244 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:13.867246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:13.867476 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:13.867699 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:13.867699 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:13.867700 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:13.867808 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:13.868202 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:13.868207 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:13.868337 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 21:05:13.868428 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 21:05:13.868600 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260808 21:05:13.869517 11471 heartbeater.cc:347] Connected to a master server at 127.14.146.254:46017
I20260808 21:05:13.869614 11471 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:13.869782 11471 heartbeater.cc:511] Master 127.14.146.254:46017 requested a full tablet report, sending...
I20260808 21:05:13.870152 10713 ts_manager.cc:194] Registered new tserver with Master: 34e607ca7bea4173974fc99cac607305 (127.14.146.195:41213)
I20260808 21:05:13.870500 10713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:50719
I20260808 21:05:13.875712 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:05:13.883766 10778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.877236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40370 (local address 127.14.146.254:46017)
0808 21:05:13.877302 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.877304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.877415 (+ 111us) server_negotiation.cc:407] Connection header received
0808 21:05:13.877459 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.877460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.877469 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.877520 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:13.878068 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.878556 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.879261 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.879479 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.879581 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.881089 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:13.881090 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:13.881090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:13.881097 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:13.882594 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.883013 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.883014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.883015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.883085 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:13.883297 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:13.883297 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:13.883297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:13.883448 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:13.883549 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.883643 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.883699 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 21:05:13.885540 10713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:05:13.887120 10713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:05:13.894230 11493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.889708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:36219 (local address 127.0.0.1:48194)
0808 21:05:13.890110 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.890120 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:13.890176 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:13.890500 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:13.890501 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:13.890503 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:13.890594 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.890596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.891602 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.891603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.892939 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.892943 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.893897 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.893898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.893982 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.893998 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 21:05:13.894078 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 21:05:13.894141 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":56,"thread_start_us":71,"threads_started":1}
I20260808 21:05:13.894244 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.889834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.14.146.193:36219)
0808 21:05:13.890059 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.890064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.890265 (+ 201us) server_negotiation.cc:407] Connection header received
0808 21:05:13.890309 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.890311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.890331 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.890406 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:13.890687 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.891494 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.893062 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.893778 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.893861 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.893916 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.894106 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.894149 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":98,"threads_started":1}
I20260808 21:05:13.894330 11490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.889833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55724 (local address 127.14.146.194:41369)
0808 21:05:13.890166 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.890170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.890184 (+ 14us) server_negotiation.cc:407] Connection header received
0808 21:05:13.890273 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.890276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.890295 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.890386 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:13.890675 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.891803 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.893110 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.893788 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.893899 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.893956 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.894191 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.894235 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":101,"threads_started":1}
I20260808 21:05:13.894482 11486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.889708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:41369 (local address 127.0.0.1:55724)
0808 21:05:13.890033 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.890099 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:13.890176 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:13.890492 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:13.890496 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:13.890498 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:13.890587 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.890590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.891912 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.891913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.893038 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.893040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.893982 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.893983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.894062 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.894066 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:13.894113 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 21:05:13.894145 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":5,"thread_start_us":74,"threads_started":1}
I20260808 21:05:13.894759 11487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.889981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41213 (local address 127.0.0.1:52440)
0808 21:05:13.890410 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.890421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:13.890466 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:13.890849 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:13.890850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:13.890852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:13.890888 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.890889 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.892193 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.892194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.893386 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.893389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.894525 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.894527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.894596 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.894600 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:13.894648 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 21:05:13.894693 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":2,"thread_start_us":73,"threads_started":1}
I20260808 21:05:13.895148 11494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.890205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52440 (local address 127.14.146.195:41213)
0808 21:05:13.890633 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.890639 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.890648 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:13.890689 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.890691 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.890706 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.890781 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:13.890980 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.892037 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.893480 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.894211 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.894916 (+ 705us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.894980 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.895025 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.895069 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":109,"threads_started":1}
I20260808 21:05:13.895221 10912 tablet_service.cc:1467] Processing CreateTablet for tablet 27ca5c9644774f4eba76e336f3f6a216 (DEFAULT_TABLE table=test-table [id=16b868d6a64a40a3aec7fb05bf580ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:13.895192 11134 tablet_service.cc:1467] Processing CreateTablet for tablet 27ca5c9644774f4eba76e336f3f6a216 (DEFAULT_TABLE table=test-table [id=16b868d6a64a40a3aec7fb05bf580ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:13.895581 11134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ca5c9644774f4eba76e336f3f6a216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:13.895589 10912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ca5c9644774f4eba76e336f3f6a216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:13.895823 11366 tablet_service.cc:1467] Processing CreateTablet for tablet 27ca5c9644774f4eba76e336f3f6a216 (DEFAULT_TABLE table=test-table [id=16b868d6a64a40a3aec7fb05bf580ee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:13.896175 11366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27ca5c9644774f4eba76e336f3f6a216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:13.898605 11495 tablet_bootstrap.cc:492] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Bootstrap starting.
I20260808 21:05:13.899019 11496 tablet_bootstrap.cc:492] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4: Bootstrap starting.
I20260808 21:05:13.899464 11495 tablet_bootstrap.cc:654] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:13.899456 11497 tablet_bootstrap.cc:492] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: Bootstrap starting.
I20260808 21:05:13.900166 11497 tablet_bootstrap.cc:654] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:13.900187 11496 tablet_bootstrap.cc:654] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:13.900188 11495 log.cc:824] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:13.900753 11496 log.cc:824] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:13.900763 11497 log.cc:824] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:13.901062 11495 tablet_bootstrap.cc:492] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: No bootstrap required, opened a new log
I20260808 21:05:13.901168 11495 ts_tablet_manager.cc:1397] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 21:05:13.901506 11497 tablet_bootstrap.cc:492] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: No bootstrap required, opened a new log
I20260808 21:05:13.901563 11497 ts_tablet_manager.cc:1397] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 21:05:13.902776 11495 raft_consensus.cc:348] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.902987 11495 raft_consensus.cc:374] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:13.903039 11495 raft_consensus.cc:729] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02af3d18d827475fb90d193f90e158ac, State: Initialized, Role: FOLLOWER
I20260808 21:05:13.903159 11495 consensus_queue.cc:260] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.903147 11497 raft_consensus.cc:348] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.903319 11497 raft_consensus.cc:374] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:13.903365 11497 raft_consensus.cc:729] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e607ca7bea4173974fc99cac607305, State: Initialized, Role: FOLLOWER
I20260808 21:05:13.903466 11495 ts_tablet_manager.cc:1428] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 21:05:13.903508 11244 heartbeater.cc:503] Master 127.14.146.254:46017 was elected leader, sending a full tablet report...
I20260808 21:05:13.903486 11497 consensus_queue.cc:260] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.903798 11497 ts_tablet_manager.cc:1428] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:05:13.903825 11471 heartbeater.cc:503] Master 127.14.146.254:46017 was elected leader, sending a full tablet report...
I20260808 21:05:13.904287 11496 tablet_bootstrap.cc:492] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4: No bootstrap required, opened a new log
I20260808 21:05:13.904363 11496 ts_tablet_manager.cc:1397] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260808 21:05:13.905885 11496 raft_consensus.cc:348] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.906081 11496 raft_consensus.cc:374] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:13.906133 11496 raft_consensus.cc:729] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26059c4483a24c12b281da24acaa3fe4, State: Initialized, Role: FOLLOWER
I20260808 21:05:13.906244 11496 consensus_queue.cc:260] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.906558 11496 ts_tablet_manager.cc:1428] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:05:13.906610 11019 heartbeater.cc:503] Master 127.14.146.254:46017 was elected leader, sending a full tablet report...
I20260808 21:05:13.933718 11507 raft_consensus.cc:482] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:05:13.933887 11507 raft_consensus.cc:504] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.934340 11507 leader_election.cc:288] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02af3d18d827475fb90d193f90e158ac (127.14.146.194:41369), 34e607ca7bea4173974fc99cac607305 (127.14.146.195:41213)
I20260808 21:05:13.937417 11022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.934533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:41213 (local address 127.14.146.193:56731)
0808 21:05:13.934580 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.934592 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:13.934660 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:13.934830 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:13.934832 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:13.934833 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:13.934919 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.934920 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.935613 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.935614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.936433 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.936436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.937215 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.937216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.937282 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.937285 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:13.937330 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 21:05:13.937363 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 21:05:13.937461 11494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.934613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:56731 (local address 127.14.146.195:41213)
0808 21:05:13.934679 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.934681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.934691 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:13.934730 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.934731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.934738 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.934821 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:13.935019 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.935521 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.936527 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.937142 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.937216 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.937225 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.937354 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.937390 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:05:13.937834 11508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.934533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:41369 (local address 127.14.146.193:50837)
0808 21:05:13.934908 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.934916 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:13.934983 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:13.935162 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:13.935163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:13.935165 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:13.935244 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.935246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.935880 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.935882 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.936792 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:13.936795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.937577 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.937578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:13.937662 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.937667 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:05:13.937722 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 21:05:13.937759 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":182,"thread_start_us":131,"threads_started":1}
I20260808 21:05:13.937845 11490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.934615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:50837 (local address 127.14.146.194:41369)
0808 21:05:13.934694 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.934697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.934980 (+ 283us) server_negotiation.cc:407] Connection header received
0808 21:05:13.935078 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.935080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.935089 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.935158 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:13.935321 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.935790 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.936883 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.937457 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.937529 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.937539 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.937731 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.937778 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:05:13.937788 11398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ca5c9644774f4eba76e336f3f6a216" candidate_uuid: "26059c4483a24c12b281da24acaa3fe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e607ca7bea4173974fc99cac607305" is_pre_election: true
I20260808 21:05:13.937971 11398 raft_consensus.cc:2454] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26059c4483a24c12b281da24acaa3fe4 in term 0.
I20260808 21:05:13.938220 10843 leader_election.cc:302] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26059c4483a24c12b281da24acaa3fe4, 34e607ca7bea4173974fc99cac607305; no voters:
I20260808 21:05:13.938230 11169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ca5c9644774f4eba76e336f3f6a216" candidate_uuid: "26059c4483a24c12b281da24acaa3fe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02af3d18d827475fb90d193f90e158ac" is_pre_election: true
I20260808 21:05:13.938364 11169 raft_consensus.cc:2454] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26059c4483a24c12b281da24acaa3fe4 in term 0.
I20260808 21:05:13.938359 11507 raft_consensus.cc:2781] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:05:13.938408 11507 raft_consensus.cc:482] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:05:13.938432 11507 raft_consensus.cc:3037] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:13.939260 11507 raft_consensus.cc:504] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.939404 11507 leader_election.cc:288] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [CANDIDATE]: Term 1 election: Requested vote from peers 02af3d18d827475fb90d193f90e158ac (127.14.146.194:41369), 34e607ca7bea4173974fc99cac607305 (127.14.146.195:41213)
I20260808 21:05:13.939584 11169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ca5c9644774f4eba76e336f3f6a216" candidate_uuid: "26059c4483a24c12b281da24acaa3fe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02af3d18d827475fb90d193f90e158ac"
I20260808 21:05:13.939654 11169 raft_consensus.cc:3037] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:13.940157 11398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27ca5c9644774f4eba76e336f3f6a216" candidate_uuid: "26059c4483a24c12b281da24acaa3fe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34e607ca7bea4173974fc99cac607305"
I20260808 21:05:13.940259 11398 raft_consensus.cc:3037] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:13.940446 11169 raft_consensus.cc:2454] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26059c4483a24c12b281da24acaa3fe4 in term 1.
I20260808 21:05:13.940624 10841 leader_election.cc:302] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02af3d18d827475fb90d193f90e158ac, 26059c4483a24c12b281da24acaa3fe4; no voters:
I20260808 21:05:13.940719 11507 raft_consensus.cc:2781] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:13.940897 11507 raft_consensus.cc:686] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [term 1 LEADER]: Becoming Leader. State: Replica: 26059c4483a24c12b281da24acaa3fe4, State: Running, Role: LEADER
I20260808 21:05:13.941016 11507 consensus_queue.cc:237] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } }
I20260808 21:05:13.941287 11398 raft_consensus.cc:2454] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26059c4483a24c12b281da24acaa3fe4 in term 1.
I20260808 21:05:13.941967 10712 catalog_manager.cc:5495] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26059c4483a24c12b281da24acaa3fe4 (127.14.146.193). New cstate: current_term: 1 leader_uuid: "26059c4483a24c12b281da24acaa3fe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26059c4483a24c12b281da24acaa3fe4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 } health_report { overall_health: UNKNOWN } } }
W20260808 21:05:13.947737 11245 tablet.cc:2369] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 21:05:13.953725 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.951254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48202 (local address 127.14.146.193:36219)
0808 21:05:13.951307 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:13.951309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:13.951319 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:13.951358 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:13.951359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:13.951380 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:13.951459 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:13.951614 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.952170 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.952960 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:13.953173 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:13.953251 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:13.953384 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:13.953481 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:13.953596 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:13.953628 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 21:05:13.953639 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:05:13.955621 11398 raft_consensus.cc:1261] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 1 FOLLOWER]: Refusing update from remote peer 26059c4483a24c12b281da24acaa3fe4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:13.955605 11169 raft_consensus.cc:1261] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 1 FOLLOWER]: Refusing update from remote peer 26059c4483a24c12b281da24acaa3fe4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:13.956008 11509 consensus_queue.cc:1035] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34e607ca7bea4173974fc99cac607305" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 41213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:13.956233 11507 consensus_queue.cc:1035] T 27ca5c9644774f4eba76e336f3f6a216 P 26059c4483a24c12b281da24acaa3fe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02af3d18d827475fb90d193f90e158ac" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 41369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:13.958425 11513 mvcc.cc:205] Tried to move back new op lower bound from 7316369874759028736 to 7316369874703376384. Current Snapshot: MvccSnapshot[applied={T|T < 7316369874759028736}]
I20260808 21:05:13.959065 11514 mvcc.cc:205] Tried to move back new op lower bound from 7316369874759028736 to 7316369874703376384. Current Snapshot: MvccSnapshot[applied={T|T < 7316369874759028736}]
I20260808 21:05:13.961562 10713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:13.961654 10713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:13.962446 10713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ea15fdacbf8d4bca8c2f69514a968570: Sending DeleteTablet for 3 replicas of tablet 27ca5c9644774f4eba76e336f3f6a216
I20260808 21:05:13.962824 11134 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ca5c9644774f4eba76e336f3f6a216 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:13 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:55724
I20260808 21:05:13.962829 11366 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ca5c9644774f4eba76e336f3f6a216 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:13 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:52440
I20260808 21:05:13.963086 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 10813
I20260808 21:05:13.963131 10912 tablet_service.cc:1514] Processing DeleteTablet for tablet 27ca5c9644774f4eba76e336f3f6a216 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:13 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:48194
I20260808 21:05:13.967355 11524 tablet_replica.cc:330] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: stopping tablet replica
I20260808 21:05:13.967485 11524 raft_consensus.cc:2229] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:13.967624 11524 raft_consensus.cc:2258] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:13.971517 11526 tablet_replica.cc:330] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: stopping tablet replica
I20260808 21:05:13.971710 11526 raft_consensus.cc:2229] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:13.971887 11526 raft_consensus.cc:2258] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:13.972954 11526 ts_tablet_manager.cc:1905] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:13.973335 11524 ts_tablet_manager.cc:1905] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:13.974851 11526 ts_tablet_manager.cc:1918] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:13.974938 11526 log.cc:1196] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/27ca5c9644774f4eba76e336f3f6a216
I20260808 21:05:13.975034 11524 ts_tablet_manager.cc:1918] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:13.975109 11524 log.cc:1196] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/27ca5c9644774f4eba76e336f3f6a216
I20260808 21:05:13.975250 11526 ts_tablet_manager.cc:1939] T 27ca5c9644774f4eba76e336f3f6a216 P 34e607ca7bea4173974fc99cac607305: Deleting consensus metadata
I20260808 21:05:13.975383 11524 ts_tablet_manager.cc:1939] T 27ca5c9644774f4eba76e336f3f6a216 P 02af3d18d827475fb90d193f90e158ac: Deleting consensus metadata
I20260808 21:05:13.975782 10692 catalog_manager.cc:4841] TS 02af3d18d827475fb90d193f90e158ac (127.14.146.194:41369): tablet 27ca5c9644774f4eba76e336f3f6a216 (table test-table [id=16b868d6a64a40a3aec7fb05bf580ee3]) successfully deleted
I20260808 21:05:13.975790 10694 catalog_manager.cc:4841] TS 34e607ca7bea4173974fc99cac607305 (127.14.146.195:41213): tablet 27ca5c9644774f4eba76e336f3f6a216 (table test-table [id=16b868d6a64a40a3aec7fb05bf580ee3]) successfully deleted
W20260808 21:05:13.977646 10694 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:36219 (error 108)
I20260808 21:05:13.977891 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 11025
I20260808 21:05:13.980835 11487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:13.978015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:36219 (local address 127.0.0.1:48210)
0808 21:05:13.980743 (+ 2728us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:13.980795 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:36219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2703}
W20260808 21:05:13.983803 10694 catalog_manager.cc:4584] TS 26059c4483a24c12b281da24acaa3fe4 (127.14.146.193:36219): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 27ca5c9644774f4eba76e336f3f6a216: Network error: Client connection negotiation failed: client connection to 127.14.146.193:36219: connect: Connection refused (error 111)
I20260808 21:05:13.992313 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 11254
I20260808 21:05:14.000198 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 10661
2026-08-08T21:05:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2150 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T21:05:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:14Z Disabled control of system clock
I20260808 21:05:14.034850 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34851
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:42673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:34851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 21:05:14.116724 11533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:14.116933 11533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:14.116954 11533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:14.118119 11533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:14.118166 11533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:14.118178 11533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:14.118191 11533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:14.118203 11533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:14.119469 11533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:42673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:34851
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:14.119660 11533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:14.119891 11533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:14.124739 11540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:14.124763 11533 server_base.cc:1034] running on GCE node
W20260808 21:05:14.124745 11541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:14.124755 11546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:14.125299 11533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:14.125660 11533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:14.126821 11533 hybrid_clock.cc:648] HybridClock initialized: now 1786223114126802 us; error 38 us; skew 500 ppm
I20260808 21:05:14.128016 11533 webserver.cc:460] Webserver started at http://127.14.146.254:33807/ using document root <none> and password file <none>
I20260808 21:05:14.128305 11533 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:14.128355 11533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:14.128511 11533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:14.129570 11533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "4a3123a3ea7d4945afe948c2c4e974e4"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "6f3d6f619d180c4f832cce1e566df108"
server_key_iv: "b4adc5a5aa0c6066461c8c35d3b61571"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.129949 11533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "4a3123a3ea7d4945afe948c2c4e974e4"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "6f3d6f619d180c4f832cce1e566df108"
server_key_iv: "b4adc5a5aa0c6066461c8c35d3b61571"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.131233 11533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:14.131929 11558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.132164 11533 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:14.132252 11533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "4a3123a3ea7d4945afe948c2c4e974e4"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "6f3d6f619d180c4f832cce1e566df108"
server_key_iv: "b4adc5a5aa0c6066461c8c35d3b61571"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.132308 11533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:14.157334 11533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:14.157641 11533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:14.157749 11533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:14.161885 11533 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:34851
I20260808 21:05:14.161957 11642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:34851 every 8 connection(s)
I20260808 21:05:14.162336 11533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:14.163344 11643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:14.165676 11643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4: Bootstrap starting.
I20260808 21:05:14.166290 11643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:14.166600 11643 log.cc:824] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:14.167320 11643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4: No bootstrap required, opened a new log
I20260808 21:05:14.168977 11643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3123a3ea7d4945afe948c2c4e974e4" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34851 } }
I20260808 21:05:14.169147 11643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:14.169199 11643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a3123a3ea7d4945afe948c2c4e974e4, State: Initialized, Role: FOLLOWER
I20260808 21:05:14.169353 11643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3123a3ea7d4945afe948c2c4e974e4" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34851 } }
I20260808 21:05:14.169443 11643 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:14.169489 11643 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:14.169541 11643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:14.169564 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 11533
I20260808 21:05:14.169696 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:14.169909 14923 external_mini_cluster.cc:1428] Setting key 4517454bb7322665a906e4347c47db22
I20260808 21:05:14.170250 11643 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3123a3ea7d4945afe948c2c4e974e4" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34851 } }
I20260808 21:05:14.170379 11643 leader_election.cc:302] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a3123a3ea7d4945afe948c2c4e974e4; no voters:
I20260808 21:05:14.170555 11643 leader_election.cc:288] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:14.170591 11648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:14.170708 11648 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [term 1 LEADER]: Becoming Leader. State: Replica: 4a3123a3ea7d4945afe948c2c4e974e4, State: Running, Role: LEADER
I20260808 21:05:14.170823 11643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:14.170790 11648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3123a3ea7d4945afe948c2c4e974e4" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34851 } }
I20260808 21:05:14.171339 11650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a3123a3ea7d4945afe948c2c4e974e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3123a3ea7d4945afe948c2c4e974e4" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34851 } } }
I20260808 21:05:14.171438 11650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:14.171764 11653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a3123a3ea7d4945afe948c2c4e974e4. Latest consensus state: current_term: 1 leader_uuid: "4a3123a3ea7d4945afe948c2c4e974e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a3123a3ea7d4945afe948c2c4e974e4" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34851 } } }
I20260808 21:05:14.171835 11653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:14.172322 11662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:14.172816 11662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:14.174463 11662 catalog_manager.cc:1347] Generated new cluster ID: a3be9da71b6b4ea7b1fc9fa9f5587141
I20260808 21:05:14.174517 11662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:14.176591 11649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.170459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33096 (local address 127.14.146.254:34851)
0808 21:05:14.170855 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.170865 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.171051 (+ 186us) server_negotiation.cc:407] Connection header received
0808 21:05:14.171180 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.171188 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.171261 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.171713 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:14.171826 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.173373 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.174364 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.174970 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.175098 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.175867 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:14.175871 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:14.175871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:14.176102 (+ 231us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:14.176143 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:14.176157 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:14.176220 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.176316 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.176389 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":106,"threads_started":1}
I20260808 21:05:14.185504 11662 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:14.186038 11662 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:14.193892 11662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4: Generated new TSK 0
I20260808 21:05:14.194074 11662 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:14.197553 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34851
--builtin_ntp_servers=127.14.146.212:42673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 21:05:14.282407 11677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:14.282644 11677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:14.282676 11677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:14.283833 11677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:14.283898 11677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:14.283941 11677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:05:14.285413 11677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:42673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:14.285697 11677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:14.286016 11677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:14.291970 11686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:14.291985 11684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:14.292301 11688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:14.292340 11677 server_base.cc:1034] running on GCE node
I20260808 21:05:14.292552 11677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:14.292829 11677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:14.293988 11677 hybrid_clock.cc:648] HybridClock initialized: now 1786223114293958 us; error 46 us; skew 500 ppm
I20260808 21:05:14.295250 11677 webserver.cc:460] Webserver started at http://127.14.146.193:36429/ using document root <none> and password file <none>
I20260808 21:05:14.295518 11677 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:14.295588 11677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:14.295749 11677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:14.296906 11677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "af653a1c41ae4b989020da133a3b0a03"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "0a800a944d46695adf8cb096fea16909"
server_key_iv: "7be18b495f0fa860f2b9178216483691"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.297279 11677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "af653a1c41ae4b989020da133a3b0a03"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "0a800a944d46695adf8cb096fea16909"
server_key_iv: "7be18b495f0fa860f2b9178216483691"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.298657 11677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:05:14.299368 11696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.299536 11677 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:14.299649 11677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "af653a1c41ae4b989020da133a3b0a03"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "0a800a944d46695adf8cb096fea16909"
server_key_iv: "7be18b495f0fa860f2b9178216483691"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.299728 11677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:14.310866 11677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:14.311188 11677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:14.311342 11677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:14.311568 11677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:14.311920 11677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:14.311973 11677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.312016 11677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:14.312042 11677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.317879 11677 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:35383
I20260808 21:05:14.317974 11896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:35383 every 8 connection(s)
I20260808 21:05:14.318300 11677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:05:14.323428 11649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.319044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:34771 (local address 127.14.146.254:34851)
0808 21:05:14.319093 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.319095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.319329 (+ 234us) server_negotiation.cc:407] Connection header received
0808 21:05:14.319801 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.319802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.319815 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.319874 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:14.320603 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.321102 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.322076 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.322275 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.322327 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.323154 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:14.323155 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:14.323155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:14.323159 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:14.323170 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:14.323173 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:14.323203 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.323295 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.323329 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:05:14.323459 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 11677
I20260808 21:05:14.323554 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:05:14.323539 11901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.319021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34851 (local address 127.14.146.193:34771)
0808 21:05:14.319208 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.319242 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:14.319718 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:14.319929 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:14.319932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:14.319941 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:14.320525 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.320531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.321192 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.321192 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.322000 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.322003 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.322349 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.322350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.322458 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.323018 (+ 560us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:14.323018 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:14.323048 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:14.323072 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:14.323212 (+ 140us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:14.323214 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:14.323217 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:14.323263 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 21:05:14.323342 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260808 21:05:14.323715 14923 external_mini_cluster.cc:1428] Setting key 20aa20be676c4370f5a69abcd48b4323
I20260808 21:05:14.324211 11897 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34851
I20260808 21:05:14.324295 11897 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:14.324512 11897 heartbeater.cc:511] Master 127.14.146.254:34851 requested a full tablet report, sending...
I20260808 21:05:14.324862 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34851
--builtin_ntp_servers=127.14.146.212:42673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 21:05:14.325105 11587 ts_manager.cc:194] Registered new tserver with Master: af653a1c41ae4b989020da133a3b0a03 (127.14.146.193:35383)
I20260808 21:05:14.325822 11587 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.193:34771
W20260808 21:05:14.409759 11907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:14.409952 11907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:14.409973 11907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:14.411101 11907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:14.411141 11907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:14.411166 11907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:05:14.412590 11907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:42673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:14.412827 11907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:14.413156 11907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:14.418244 11916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:14.418259 11919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:14.418249 11917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:14.418676 11907 server_base.cc:1034] running on GCE node
I20260808 21:05:14.418854 11907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:14.419041 11907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:14.420147 11907 hybrid_clock.cc:648] HybridClock initialized: now 1786223114420122 us; error 35 us; skew 500 ppm
I20260808 21:05:14.421358 11907 webserver.cc:460] Webserver started at http://127.14.146.194:36689/ using document root <none> and password file <none>
I20260808 21:05:14.421640 11907 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:14.421712 11907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:14.421875 11907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:14.422916 11907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "4d5149ed67aa40fea8ce1d857502723f"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "98bb0db6f7a0d783bc97fa663cb00534"
server_key_iv: "67588e3ee91c6bdf99a509e458d54edf"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.423300 11907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "4d5149ed67aa40fea8ce1d857502723f"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "98bb0db6f7a0d783bc97fa663cb00534"
server_key_iv: "67588e3ee91c6bdf99a509e458d54edf"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.424726 11907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:14.425429 11926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.425604 11907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:14.425729 11907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "4d5149ed67aa40fea8ce1d857502723f"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "98bb0db6f7a0d783bc97fa663cb00534"
server_key_iv: "67588e3ee91c6bdf99a509e458d54edf"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.425806 11907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:14.448928 11907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:14.449262 11907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:14.449419 11907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:14.449669 11907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:14.450014 11907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:14.450069 11907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.450105 11907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:14.450134 11907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.455991 11907 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:38219
I20260808 21:05:14.456041 12109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:38219 every 8 connection(s)
I20260808 21:05:14.456404 11907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:05:14.460841 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 11907
I20260808 21:05:14.460944 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:05:14.461186 14923 external_mini_cluster.cc:1428] Setting key b291279cdd8afda996bdd04c169a2f1e
I20260808 21:05:14.461810 11649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.457146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:49389 (local address 127.14.146.254:34851)
0808 21:05:14.457238 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.457241 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.457445 (+ 204us) server_negotiation.cc:407] Connection header received
0808 21:05:14.457925 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.457926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.457937 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.457992 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:14.458642 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.459144 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.460142 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.460328 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.460380 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.461460 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:14.461462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:14.461463 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:14.461470 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:14.461506 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:14.461512 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:14.461576 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.461698 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.461728 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 21:05:14.461987 12114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.457113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34851 (local address 127.14.146.194:49389)
0808 21:05:14.457321 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.457354 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:14.457837 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:14.458045 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:14.458049 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:14.458057 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:14.458566 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.458570 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.459224 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.459225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.460008 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.460010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.460400 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.460401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.460510 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.461167 (+ 657us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:14.461168 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:14.461207 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:14.461237 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:14.461590 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:14.461597 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:14.461600 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:14.461681 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 21:05:14.461779 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":110,"threads_started":1}
I20260808 21:05:14.462455 12110 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34851
I20260808 21:05:14.462556 12110 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:14.462548 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34851
--builtin_ntp_servers=127.14.146.212:42673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 21:05:14.462764 12110 heartbeater.cc:511] Master 127.14.146.254:34851 requested a full tablet report, sending...
I20260808 21:05:14.463142 11587 ts_manager.cc:194] Registered new tserver with Master: 4d5149ed67aa40fea8ce1d857502723f (127.14.146.194:38219)
I20260808 21:05:14.463513 11587 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.194:49389
W20260808 21:05:14.546747 12115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:14.546952 12115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:14.546972 12115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:14.548146 12115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:14.548184 12115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:14.548209 12115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:05:14.549517 12115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:42673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:14.549706 12115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:14.549957 12115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:14.555166 12126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:14.555064 12124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:14.555155 12115 server_base.cc:1034] running on GCE node
W20260808 21:05:14.555064 12123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:14.555644 12115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:14.555878 12115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:14.557016 12115 hybrid_clock.cc:648] HybridClock initialized: now 1786223114556987 us; error 46 us; skew 500 ppm
I20260808 21:05:14.558291 12115 webserver.cc:460] Webserver started at http://127.14.146.195:33269/ using document root <none> and password file <none>
I20260808 21:05:14.558506 12115 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:14.558547 12115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:14.558645 12115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:14.559669 12115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "e326baec244347879158197a0b689aeb"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "3c003f2892b408c8e3f18f1c5e04ef29"
server_key_iv: "9816a149291ea662c740921f35457bc6"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.559967 12115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "e326baec244347879158197a0b689aeb"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "3c003f2892b408c8e3f18f1c5e04ef29"
server_key_iv: "9816a149291ea662c740921f35457bc6"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.561300 12115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:05:14.561990 12133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.562170 12115 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:05:14.562242 12115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "e326baec244347879158197a0b689aeb"
format_stamp: "Formatted at 2026-08-08 21:05:14 on dist-test-slave-t3q3"
server_key: "3c003f2892b408c8e3f18f1c5e04ef29"
server_key_iv: "9816a149291ea662c740921f35457bc6"
server_key_version: "encryptionkey@0"
I20260808 21:05:14.562294 12115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:14.580448 12115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:14.580717 12115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:14.580821 12115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:14.581019 12115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:14.581292 12115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:14.581322 12115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.581342 12115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:14.581357 12115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:14.587127 12115 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:45973
I20260808 21:05:14.587185 12316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:45973 every 8 connection(s)
I20260808 21:05:14.587507 12115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:05:14.588546 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 12115
I20260808 21:05:14.588626 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:05:14.588830 14923 external_mini_cluster.cc:1428] Setting key 162a1502b89e22e2c9dba536742ec503
I20260808 21:05:14.593042 11649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.588318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:56077 (local address 127.14.146.254:34851)
0808 21:05:14.588400 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.588403 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.588666 (+ 263us) server_negotiation.cc:407] Connection header received
0808 21:05:14.589372 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.589373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.589386 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.589436 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:14.590146 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.590657 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.591680 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.591888 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.591965 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.592737 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:14.592738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:14.592739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:14.592744 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:14.592757 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:14.592762 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:14.592814 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.592920 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.592950 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 21:05:14.593305 12321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.588293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34851 (local address 127.14.146.195:56077)
0808 21:05:14.588507 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.588548 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:14.589242 (+ 694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:14.589518 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:14.589522 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:14.589532 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:14.590043 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.590046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.590758 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.590759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.591562 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.591564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.591984 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.591986 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.592135 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.592588 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:14.592589 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:14.592617 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:14.592647 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:14.592824 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:14.592829 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:14.592833 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:14.592919 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 21:05:14.593031 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":124,"threads_started":1}
I20260808 21:05:14.593756 12317 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34851
I20260808 21:05:14.593842 12317 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:14.594043 12317 heartbeater.cc:511] Master 127.14.146.254:34851 requested a full tablet report, sending...
I20260808 21:05:14.594421 11587 ts_manager.cc:194] Registered new tserver with Master: e326baec244347879158197a0b689aeb (127.14.146.195:45973)
I20260808 21:05:14.594800 11587 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.195:56077
I20260808 21:05:14.600525 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:05:14.604648 11649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.601916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33098 (local address 127.14.146.254:34851)
0808 21:05:14.602001 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.602003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.602093 (+ 90us) server_negotiation.cc:407] Connection header received
0808 21:05:14.602152 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.602152 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.602162 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.602213 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:14.602335 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.602777 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.603541 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.603728 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.603782 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.604367 (+ 585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:14.604368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:14.604369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:14.604373 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:14.604385 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:14.604389 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:14.604458 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.604521 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.604530 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 21:05:14.606086 11587 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33098:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:05:14.607606 11587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:05:14.614022 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.609732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:38219 (local address 127.0.0.1:37748)
0808 21:05:14.609929 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.609970 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:14.610035 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:14.610729 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:14.610730 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:14.610732 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:14.610773 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.610774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.611627 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.611628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.612755 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.612758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.613711 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.613712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.613800 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.613815 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 21:05:14.613887 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 21:05:14.613941 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":60,"thread_start_us":66,"threads_started":1}
I20260808 21:05:14.614050 12345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.610029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37748 (local address 127.14.146.194:38219)
0808 21:05:14.610221 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.610225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.610235 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:14.610278 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.610280 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.610291 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.610395 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:14.610840 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.611525 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.612849 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.613603 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.613700 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.613795 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.613912 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.613956 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":78,"threads_started":1}
I20260808 21:05:14.614218 12343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.609897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48554 (local address 127.14.146.195:45973)
0808 21:05:14.610224 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.610227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.610234 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:05:14.610265 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.610267 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.610278 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.610336 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:14.610539 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.611577 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.613006 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.613676 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.613739 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.613806 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.614071 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.614130 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":76,"threads_started":1}
I20260808 21:05:14.614272 12338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.609774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:45973 (local address 127.0.0.1:48554)
0808 21:05:14.610072 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.610082 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:14.610123 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:14.610378 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:14.610381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:14.610383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:14.610449 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.610451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.611672 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.611673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.612899 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.612901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.613851 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.613852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.613932 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.613936 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:14.613989 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 21:05:14.614027 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":26,"thread_start_us":104,"threads_started":1}
I20260808 21:05:14.614858 12344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.609996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44896 (local address 127.14.146.193:35383)
0808 21:05:14.610183 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.610188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.610574 (+ 386us) server_negotiation.cc:407] Connection header received
0808 21:05:14.610635 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.610637 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.610654 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.610737 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:14.610898 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.611972 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.613205 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.613734 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.613806 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.613896 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.614727 (+ 831us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.614778 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260808 21:05:14.614789 12002 tablet_service.cc:1467] Processing CreateTablet for tablet 942be3a9e2fb46628a612807898c7173 (DEFAULT_TABLE table=test-table [id=df387fe4007f4687befba939583fb06a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:14.614920 12210 tablet_service.cc:1467] Processing CreateTablet for tablet 942be3a9e2fb46628a612807898c7173 (DEFAULT_TABLE table=test-table [id=df387fe4007f4687befba939583fb06a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:14.615075 12002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 942be3a9e2fb46628a612807898c7173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:14.615198 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.609778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:35383 (local address 127.0.0.1:44896)
0808 21:05:14.610444 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.610454 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:14.610506 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:14.610749 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:14.610750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:14.610752 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:14.610804 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.610806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.612079 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.612080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.613121 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.613123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.613931 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.613932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.613986 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.613989 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:14.614037 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 21:05:14.615044 (+ 1007us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":13,"thread_start_us":97,"threads_started":1}
I20260808 21:05:14.615278 12210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 942be3a9e2fb46628a612807898c7173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:14.616111 11774 tablet_service.cc:1467] Processing CreateTablet for tablet 942be3a9e2fb46628a612807898c7173 (DEFAULT_TABLE table=test-table [id=df387fe4007f4687befba939583fb06a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:14.616461 11774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 942be3a9e2fb46628a612807898c7173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:14.618094 12346 tablet_bootstrap.cc:492] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: Bootstrap starting.
I20260808 21:05:14.618759 12346 tablet_bootstrap.cc:654] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:14.619138 12346 log.cc:824] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:14.619920 12346 tablet_bootstrap.cc:492] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: No bootstrap required, opened a new log
I20260808 21:05:14.619920 12353 tablet_bootstrap.cc:492] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03: Bootstrap starting.
I20260808 21:05:14.619992 12346 ts_tablet_manager.cc:1397] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:05:14.620000 12349 tablet_bootstrap.cc:492] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: Bootstrap starting.
I20260808 21:05:14.620568 12349 tablet_bootstrap.cc:654] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:14.620590 12353 tablet_bootstrap.cc:654] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:14.620870 12349 log.cc:824] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:14.620958 12353 log.cc:824] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:14.621688 12353 tablet_bootstrap.cc:492] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03: No bootstrap required, opened a new log
I20260808 21:05:14.621683 12349 tablet_bootstrap.cc:492] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: No bootstrap required, opened a new log
I20260808 21:05:14.621764 12349 ts_tablet_manager.cc:1397] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:05:14.621769 12353 ts_tablet_manager.cc:1397] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 21:05:14.622746 12346 raft_consensus.cc:348] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.622916 12346 raft_consensus.cc:374] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:14.622956 12346 raft_consensus.cc:729] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e326baec244347879158197a0b689aeb, State: Initialized, Role: FOLLOWER
I20260808 21:05:14.623097 12346 consensus_queue.cc:260] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.623368 12346 ts_tablet_manager.cc:1428] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260808 21:05:14.623416 12317 heartbeater.cc:503] Master 127.14.146.254:34851 was elected leader, sending a full tablet report...
I20260808 21:05:14.624054 12353 raft_consensus.cc:348] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.624245 12353 raft_consensus.cc:374] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:14.624291 12353 raft_consensus.cc:729] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af653a1c41ae4b989020da133a3b0a03, State: Initialized, Role: FOLLOWER
I20260808 21:05:14.624212 12349 raft_consensus.cc:348] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.624344 12349 raft_consensus.cc:374] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:14.624374 12349 raft_consensus.cc:729] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d5149ed67aa40fea8ce1d857502723f, State: Initialized, Role: FOLLOWER
I20260808 21:05:14.624408 12353 consensus_queue.cc:260] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.624524 12349 consensus_queue.cc:260] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.624652 12353 ts_tablet_manager.cc:1428] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260808 21:05:14.624778 11897 heartbeater.cc:503] Master 127.14.146.254:34851 was elected leader, sending a full tablet report...
I20260808 21:05:14.624790 12349 ts_tablet_manager.cc:1428] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:05:14.624893 12110 heartbeater.cc:503] Master 127.14.146.254:34851 was elected leader, sending a full tablet report...
I20260808 21:05:14.668491 12359 raft_consensus.cc:482] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:05:14.668695 12359 raft_consensus.cc:504] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.669132 12359 leader_election.cc:288] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d5149ed67aa40fea8ce1d857502723f (127.14.146.194:38219), af653a1c41ae4b989020da133a3b0a03 (127.14.146.193:35383)
I20260808 21:05:14.673183 12321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.669322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:38219 (local address 127.14.146.195:47215)
0808 21:05:14.669377 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.669393 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:14.669439 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:14.669719 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:14.669719 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:14.669721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:14.669803 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.669805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.670775 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.670776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.672122 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.672126 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.672885 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.672886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.672967 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.672972 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:05:14.673051 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 21:05:14.673108 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":71}
I20260808 21:05:14.673187 12345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.669479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:47215 (local address 127.14.146.194:38219)
0808 21:05:14.669529 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.669531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.669542 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:05:14.669576 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.669577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.669611 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.669698 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:14.669922 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.670688 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.672228 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.672794 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.672871 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.672879 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.673072 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.673115 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:05:14.673197 12344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.669492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:44023 (local address 127.14.146.193:35383)
0808 21:05:14.669548 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.669551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.669617 (+ 66us) server_negotiation.cc:407] Connection header received
0808 21:05:14.669652 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.669654 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.669666 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.669723 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:14.669921 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.670699 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.672228 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.672794 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.672871 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.672879 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.673072 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.673114 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 21:05:14.673417 12363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.669345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:35383 (local address 127.14.146.195:44023)
0808 21:05:14.669549 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.669557 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:14.669609 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:14.669742 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:14.669743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:14.669744 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:14.669803 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.669805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.670775 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.670776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.672141 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:14.672143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.672887 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.672888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:14.672974 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.672977 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:14.673051 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 21:05:14.673315 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":54,"thread_start_us":125,"threads_started":1}
I20260808 21:05:14.673588 12030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "942be3a9e2fb46628a612807898c7173" candidate_uuid: "e326baec244347879158197a0b689aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5149ed67aa40fea8ce1d857502723f" is_pre_election: true
I20260808 21:05:14.673769 12030 raft_consensus.cc:2454] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e326baec244347879158197a0b689aeb in term 0.
I20260808 21:05:14.673796 11814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "942be3a9e2fb46628a612807898c7173" candidate_uuid: "e326baec244347879158197a0b689aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af653a1c41ae4b989020da133a3b0a03" is_pre_election: true
I20260808 21:05:14.673950 11814 raft_consensus.cc:2454] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e326baec244347879158197a0b689aeb in term 0.
I20260808 21:05:14.674042 12135 leader_election.cc:302] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5149ed67aa40fea8ce1d857502723f, e326baec244347879158197a0b689aeb; no voters:
I20260808 21:05:14.674177 12359 raft_consensus.cc:2781] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:05:14.674234 12359 raft_consensus.cc:482] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:05:14.674263 12359 raft_consensus.cc:3037] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:14.674948 12359 raft_consensus.cc:504] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.675091 12359 leader_election.cc:288] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [CANDIDATE]: Term 1 election: Requested vote from peers 4d5149ed67aa40fea8ce1d857502723f (127.14.146.194:38219), af653a1c41ae4b989020da133a3b0a03 (127.14.146.193:35383)
I20260808 21:05:14.675246 12030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "942be3a9e2fb46628a612807898c7173" candidate_uuid: "e326baec244347879158197a0b689aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d5149ed67aa40fea8ce1d857502723f"
I20260808 21:05:14.675279 11814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "942be3a9e2fb46628a612807898c7173" candidate_uuid: "e326baec244347879158197a0b689aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af653a1c41ae4b989020da133a3b0a03"
I20260808 21:05:14.675325 12030 raft_consensus.cc:3037] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:14.675382 11814 raft_consensus.cc:3037] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:14.676054 12030 raft_consensus.cc:2454] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e326baec244347879158197a0b689aeb in term 1.
I20260808 21:05:14.676277 12135 leader_election.cc:302] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d5149ed67aa40fea8ce1d857502723f, e326baec244347879158197a0b689aeb; no voters:
I20260808 21:05:14.676321 11814 raft_consensus.cc:2454] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e326baec244347879158197a0b689aeb in term 1.
I20260808 21:05:14.676378 12359 raft_consensus.cc:2781] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:14.676545 12359 raft_consensus.cc:686] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 1 LEADER]: Becoming Leader. State: Replica: e326baec244347879158197a0b689aeb, State: Running, Role: LEADER
I20260808 21:05:14.676652 12359 consensus_queue.cc:237] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } }
I20260808 21:05:14.677450 11586 catalog_manager.cc:5495] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb reported cstate change: term changed from 0 to 1, leader changed from <none> to e326baec244347879158197a0b689aeb (127.14.146.195). New cstate: current_term: 1 leader_uuid: "e326baec244347879158197a0b689aeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e326baec244347879158197a0b689aeb" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 45973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 } health_report { overall_health: UNKNOWN } } }
I20260808 21:05:14.687974 12343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.685778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48562 (local address 127.14.146.195:45973)
0808 21:05:14.685837 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:14.685839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:14.685855 (+ 16us) server_negotiation.cc:407] Connection header received
0808 21:05:14.685932 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:14.685932 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:14.685948 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:14.686010 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:14.686125 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.686567 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.687258 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:14.687432 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:14.687481 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:14.687615 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:14.687766 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:14.687862 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:14.687897 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 21:05:14.687904 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:05:14.689652 12030 raft_consensus.cc:1261] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 1 FOLLOWER]: Refusing update from remote peer e326baec244347879158197a0b689aeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:14.689673 11814 raft_consensus.cc:1261] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 1 FOLLOWER]: Refusing update from remote peer e326baec244347879158197a0b689aeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:14.689957 12359 consensus_queue.cc:1035] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d5149ed67aa40fea8ce1d857502723f" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 38219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:14.690090 12364 consensus_queue.cc:1035] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "af653a1c41ae4b989020da133a3b0a03" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 35383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:14.692831 12371 mvcc.cc:205] Tried to move back new op lower bound from 7316369877766389760 to 7316369877716246528. Current Snapshot: MvccSnapshot[applied={T|T < 7316369877766389760 or (T in {7316369877766389760})}]
I20260808 21:05:14.693393 12373 mvcc.cc:205] Tried to move back new op lower bound from 7316369877766389760 to 7316369877716246528. Current Snapshot: MvccSnapshot[applied={T|T < 7316369877766389760 or (T in {7316369877766389760})}]
I20260808 21:05:14.695107 11586 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:14.695214 11586 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33098:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:14.695973 11586 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4a3123a3ea7d4945afe948c2c4e974e4: Sending DeleteTablet for 3 replicas of tablet 942be3a9e2fb46628a612807898c7173
I20260808 21:05:14.696341 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet 942be3a9e2fb46628a612807898c7173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:14 UTC) from {username='slave'} at 127.0.0.1:44896
I20260808 21:05:14.696394 12210 tablet_service.cc:1514] Processing DeleteTablet for tablet 942be3a9e2fb46628a612807898c7173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:14 UTC) from {username='slave'} at 127.0.0.1:48554
I20260808 21:05:14.696563 12382 tablet_replica.cc:330] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03: stopping tablet replica
I20260808 21:05:14.696663 12382 raft_consensus.cc:2229] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:14.696673 12002 tablet_service.cc:1514] Processing DeleteTablet for tablet 942be3a9e2fb46628a612807898c7173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:14 UTC) from {username='slave'} at 127.0.0.1:37748
I20260808 21:05:14.696785 12382 raft_consensus.cc:2258] T 942be3a9e2fb46628a612807898c7173 P af653a1c41ae4b989020da133a3b0a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:14.696805 12383 tablet_replica.cc:330] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: stopping tablet replica
I20260808 21:05:14.696867 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 11677
I20260808 21:05:14.696969 12383 raft_consensus.cc:2229] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:05:14.697103 12383 raft_consensus.cc:2258] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:14.697842 12383 ts_tablet_manager.cc:1905] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:14.699476 12383 ts_tablet_manager.cc:1918] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:14.699576 12383 log.cc:1196] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/942be3a9e2fb46628a612807898c7173
I20260808 21:05:14.699878 12383 ts_tablet_manager.cc:1939] T 942be3a9e2fb46628a612807898c7173 P e326baec244347879158197a0b689aeb: Deleting consensus metadata
I20260808 21:05:14.700310 11562 catalog_manager.cc:4841] TS e326baec244347879158197a0b689aeb (127.14.146.195:45973): tablet 942be3a9e2fb46628a612807898c7173 (table test-table [id=df387fe4007f4687befba939583fb06a]) successfully deleted
I20260808 21:05:14.708719 12384 tablet_replica.cc:330] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: stopping tablet replica
I20260808 21:05:14.709512 12384 raft_consensus.cc:2229] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:14.709661 12384 raft_consensus.cc:2258] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:14.711063 12384 ts_tablet_manager.cc:1905] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:14.712582 12384 ts_tablet_manager.cc:1918] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:14.712651 12384 log.cc:1196] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/942be3a9e2fb46628a612807898c7173
I20260808 21:05:14.712906 12384 ts_tablet_manager.cc:1939] T 942be3a9e2fb46628a612807898c7173 P 4d5149ed67aa40fea8ce1d857502723f: Deleting consensus metadata
I20260808 21:05:14.713325 11560 catalog_manager.cc:4841] TS 4d5149ed67aa40fea8ce1d857502723f (127.14.146.194:38219): tablet 942be3a9e2fb46628a612807898c7173 (table test-table [id=df387fe4007f4687befba939583fb06a]) successfully deleted
W20260808 21:05:14.716184 11561 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:35383 (error 108)
I20260808 21:05:14.716702 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:14.716552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:35383 (local address 127.0.0.1:44910)
0808 21:05:14.716613 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:14.716673 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:35383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 21:05:14.716820 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 11907
W20260808 21:05:14.728055 11561 catalog_manager.cc:4584] TS af653a1c41ae4b989020da133a3b0a03 (127.14.146.193:35383): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 942be3a9e2fb46628a612807898c7173: Network error: Client connection negotiation failed: client connection to 127.14.146.193:35383: connect: Connection refused (error 111)
I20260808 21:05:14.734871 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 12115
I20260808 21:05:14.745103 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 11533
2026-08-08T21:05:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (742 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:14 dist-test-slave-t3q3 krb5kdc[12390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:14 dist-test-slave-t3q3 krb5kdc[12390](info): set up 2 sockets
Aug 08 21:05:14 dist-test-slave-t3q3 krb5kdc[12390](info): commencing operation
krb5kdc: starting...
W20260808 21:05:15.989511 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:16.115216 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34555
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:34555
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:16.199034 12412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:16.199231 12412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:16.199254 12412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:16.200510 12412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:16.200553 12412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:16.200568 12412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:16.200582 12412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:16.200593 12412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:16.202075 12412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:34555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:34555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:16.202308 12412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:16.202554 12412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:16.207645 12428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:16.207643 12430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:16.207751 12412 server_base.cc:1034] running on GCE node
W20260808 21:05:16.207859 12435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:16.208177 12412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:16.208514 12412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:16.209662 12412 hybrid_clock.cc:648] HybridClock initialized: now 1786223116209643 us; error 43 us; skew 500 ppm
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:16.212340 12412 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:16.212867 12412 webserver.cc:460] Webserver started at http://127.14.146.254:44341/ using document root <none> and password file <none>
I20260808 21:05:16.213135 12412 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:16.213182 12412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:16.213344 12412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:16.214497 12412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "2abe71cc809d4f00a947f14ca53e0564"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "e84618b79b3142733c0259e5b4309c8c"
server_key_iv: "8a8b3961065ebb23f3cec1b7039464da"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.214879 12412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "2abe71cc809d4f00a947f14ca53e0564"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "e84618b79b3142733c0259e5b4309c8c"
server_key_iv: "8a8b3961065ebb23f3cec1b7039464da"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.216271 12412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:16.216990 12449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.217157 12412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:05:16.217252 12412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "2abe71cc809d4f00a947f14ca53e0564"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "e84618b79b3142733c0259e5b4309c8c"
server_key_iv: "8a8b3961065ebb23f3cec1b7039464da"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.217320 12412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:16.240048 12412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:16.242087 12412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:16.242240 12412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:16.246495 12412 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:34555
I20260808 21:05:16.246573 12544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:34555 every 8 connection(s)
I20260808 21:05:16.246935 12412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:16.247809 12545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:16.250171 12545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564: Bootstrap starting.
I20260808 21:05:16.250770 12545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:16.251045 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 12412
I20260808 21:05:16.251070 12545 log.cc:824] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:16.251163 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:16.251359 14923 external_mini_cluster.cc:1428] Setting key c26c329db11b6859162873cf9e1ab6a6
I20260808 21:05:16.251986 12545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564: No bootstrap required, opened a new log
I20260808 21:05:16.254707 12545 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abe71cc809d4f00a947f14ca53e0564" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34555 } }
I20260808 21:05:16.254882 12545 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:16.254917 12545 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2abe71cc809d4f00a947f14ca53e0564, State: Initialized, Role: FOLLOWER
I20260808 21:05:16.255033 12545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abe71cc809d4f00a947f14ca53e0564" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34555 } }
I20260808 21:05:16.255100 12545 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:16.255127 12545 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:16.255172 12545 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:16.255791 12545 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abe71cc809d4f00a947f14ca53e0564" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34555 } }
I20260808 21:05:16.255882 12545 leader_election.cc:302] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2abe71cc809d4f00a947f14ca53e0564; no voters:
I20260808 21:05:16.256117 12545 leader_election.cc:288] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:16.256147 12554 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:16.256278 12554 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [term 1 LEADER]: Becoming Leader. State: Replica: 2abe71cc809d4f00a947f14ca53e0564, State: Running, Role: LEADER
I20260808 21:05:16.256363 12554 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abe71cc809d4f00a947f14ca53e0564" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34555 } }
I20260808 21:05:16.256397 12545 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:16.256716 12554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2abe71cc809d4f00a947f14ca53e0564. Latest consensus state: current_term: 1 leader_uuid: "2abe71cc809d4f00a947f14ca53e0564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abe71cc809d4f00a947f14ca53e0564" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34555 } } }
I20260808 21:05:16.256726 12558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2abe71cc809d4f00a947f14ca53e0564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2abe71cc809d4f00a947f14ca53e0564" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 34555 } } }
I20260808 21:05:16.256801 12554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:16.256836 12558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:16.257004 12562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:16.257575 12562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:16.261333 12562 catalog_manager.cc:1347] Generated new cluster ID: a69ac2b2c8f5450db26e33a10f058888
I20260808 21:05:16.261392 12562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:16.262825 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.251876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48664 (local address 127.14.146.254:34555)
0808 21:05:16.252088 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.252098 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.252152 (+ 54us) server_negotiation.cc:407] Connection header received
0808 21:05:16.252544 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.252550 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.252593 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.252703 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:16.253526 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.254411 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.255460 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.255881 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.255993 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.259093 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:16.259098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:16.259098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:16.259110 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:16.261063 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.261554 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.261558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.261558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.261684 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.261911 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.261912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.261912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.262223 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:16.262396 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.262466 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.262607 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260808 21:05:16.273342 12562 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:16.273916 12562 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:16.280295 12562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564: Generated new TSK 0
I20260808 21:05:16.280485 12562 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
Entry for principal kudu/127.14.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab.
I20260808 21:05:16.317333 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34555
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:16.402784 12586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:16.402985 12586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:16.403008 12586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:16.404309 12586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:16.404351 12586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:16.404378 12586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:05:16.405850 12586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.193.keytab
--principal=kudu/127.14.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:16.406083 12586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:16.406332 12586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:16.411490 12596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:16.411520 12608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:16.411573 12586 server_base.cc:1034] running on GCE node
W20260808 21:05:16.411536 12592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:16.411904 12586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:16.412199 12586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:16.413342 12586 hybrid_clock.cc:648] HybridClock initialized: now 1786223116413322 us; error 37 us; skew 500 ppm
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:16.415772 12586 init.cc:377] Logged in from keytab as kudu/127.14.146.193@KRBTEST.COM (short username kudu)
I20260808 21:05:16.416230 12586 webserver.cc:460] Webserver started at http://127.14.146.193:40567/ using document root <none> and password file <none>
I20260808 21:05:16.416435 12586 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:16.416476 12586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:16.416565 12586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:16.417531 12586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "348eb1154f2748f2a83626b5046628d4"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "aaebe3e2cd5ba8de4ef02e2762079bc8"
server_key_iv: "c976dde51808ea81495244ec1c2ac416"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.417845 12586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "348eb1154f2748f2a83626b5046628d4"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "aaebe3e2cd5ba8de4ef02e2762079bc8"
server_key_iv: "c976dde51808ea81495244ec1c2ac416"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.419096 12586 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:16.419799 12617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.420015 12586 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:05:16.420138 12586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "348eb1154f2748f2a83626b5046628d4"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "aaebe3e2cd5ba8de4ef02e2762079bc8"
server_key_iv: "c976dde51808ea81495244ec1c2ac416"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.420208 12586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:16.432663 12586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:16.434432 12586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:16.434540 12586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:16.434718 12586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:16.434958 12586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:16.434988 12586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.435009 12586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:16.435022 12586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.440889 12586 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:44311
I20260808 21:05:16.440943 12808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:44311 every 8 connection(s)
I20260808 21:05:16.441249 12586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:05:16.443660 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 12586
I20260808 21:05:16.443769 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:05:16.443964 14923 external_mini_cluster.cc:1428] Setting key 80c1c9c8e77182f464da040d482db1e2
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.193@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:16.450968 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.441938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:45425 (local address 127.14.146.254:34555)
0808 21:05:16.441981 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.441983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.442186 (+ 203us) server_negotiation.cc:407] Connection header received
0808 21:05:16.442670 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.442671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.442680 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.442733 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:16.443622 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.444373 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.445402 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.445628 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.445707 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.448094 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:16.448096 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:16.448096 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:16.448103 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:16.449507 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.449978 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.449980 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.449980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.450050 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.450312 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.450313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.450314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.450430 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:16.450510 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.450788 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.450874 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:05:16.451160 12811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.441893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34555 (local address 127.14.146.193:45425)
0808 21:05:16.442054 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.442096 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:16.442578 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:16.442791 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:16.442794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:16.443343 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:16.443526 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.443531 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.444479 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.444480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.445294 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.445296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.445717 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.445718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.445853 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.446369 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:16.446381 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:16.447969 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:16.449602 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:16.449641 (+ 39us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:16.449643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:16.449895 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:16.450122 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:16.450123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:16.450124 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:16.450241 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:16.450501 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:16.450509 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:16.450653 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 21:05:16.450755 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 21:05:16.450912 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
I20260808 21:05:16.451645 12809 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34555
I20260808 21:05:16.451736 12809 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:16.451923 12809 heartbeater.cc:511] Master 127.14.146.254:34555 requested a full tablet report, sending...
I20260808 21:05:16.452540 12471 ts_manager.cc:194] Registered new tserver with Master: 348eb1154f2748f2a83626b5046628d4 (127.14.146.193:44311)
WARNING: no policy specified for kudu/127.14.146.194@KRBTEST.COM; defaulting to no policy
I20260808 21:05:16.453536 12471 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.193@KRBTEST.COM'} at 127.14.146.193:45425
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
Entry for principal kudu/127.14.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab.
I20260808 21:05:16.470677 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34555
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:16.556103 12816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:16.556428 12816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:16.556458 12816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:16.557626 12816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:16.557667 12816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:16.557693 12816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:05:16.559056 12816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.194.keytab
--principal=kudu/127.14.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:16.559239 12816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:16.559409 12816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:16.564427 12830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:16.564433 12833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:16.564515 12825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:16.564671 12816 server_base.cc:1034] running on GCE node
I20260808 21:05:16.564895 12816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:16.565094 12816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:16.566274 12816 hybrid_clock.cc:648] HybridClock initialized: now 1786223116566263 us; error 32 us; skew 500 ppm
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:16.568847 12816 init.cc:377] Logged in from keytab as kudu/127.14.146.194@KRBTEST.COM (short username kudu)
I20260808 21:05:16.569346 12816 webserver.cc:460] Webserver started at http://127.14.146.194:40585/ using document root <none> and password file <none>
I20260808 21:05:16.569533 12816 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:16.569573 12816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:16.569664 12816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:16.570662 12816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "f70e7388a04c4a6eaf87b252a2119a60"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "6da7c49f0cdc1577a2876fe1275bd1ae"
server_key_iv: "ac501f6b250a27644639fbe2f2a21bc1"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.570969 12816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "f70e7388a04c4a6eaf87b252a2119a60"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "6da7c49f0cdc1577a2876fe1275bd1ae"
server_key_iv: "ac501f6b250a27644639fbe2f2a21bc1"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.572326 12816 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:05:16.573092 12850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.573302 12816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:16.573416 12816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "f70e7388a04c4a6eaf87b252a2119a60"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "6da7c49f0cdc1577a2876fe1275bd1ae"
server_key_iv: "ac501f6b250a27644639fbe2f2a21bc1"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.573493 12816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:16.592314 12816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:16.594187 12816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:16.594355 12816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:16.594592 12816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:16.594904 12816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:16.594960 12816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.595005 12816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:16.595029 12816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.600867 12816 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:39463
I20260808 21:05:16.600916 13038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:39463 every 8 connection(s)
I20260808 21:05:16.601230 12816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:05:16.606168 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 12816
I20260808 21:05:16.606262 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:05:16.606483 14923 external_mini_cluster.cc:1428] Setting key 478deeb526f63f5d88ad45cb0d71fb84
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.194@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:16.611339 13045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.601885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34555 (local address 127.14.146.194:46655)
0808 21:05:16.602046 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.602092 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:16.602602 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:16.602852 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:16.602856 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:16.603445 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:16.603636 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.603641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.604401 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.604403 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.605206 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.605208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.605592 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.605593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.605729 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.606257 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:16.606267 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:16.608168 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:16.609981 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:16.609988 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:16.609989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:16.610220 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:16.610451 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:16.610452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:16.610452 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:16.610565 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:16.610867 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:16.610871 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:16.610983 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 21:05:16.611068 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 21:05:16.611185 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":66,"threads_started":1}
I20260808 21:05:16.611344 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.601945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:46655 (local address 127.14.146.254:34555)
0808 21:05:16.601994 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.601996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.602187 (+ 191us) server_negotiation.cc:407] Connection header received
0808 21:05:16.602711 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.602712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.602725 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.602784 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:16.603743 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.604307 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.605312 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.605509 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.605585 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.608264 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:16.608265 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:16.608265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:16.608271 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:16.609873 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.610301 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.610302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.610303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.610373 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.610640 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.610641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.610641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.610788 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:16.610861 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.611115 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.611209 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:05:16.611833 13041 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34555
I20260808 21:05:16.611953 13041 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:16.612195 13041 heartbeater.cc:511] Master 127.14.146.254:34555 requested a full tablet report, sending...
I20260808 21:05:16.612615 12471 ts_manager.cc:194] Registered new tserver with Master: f70e7388a04c4a6eaf87b252a2119a60 (127.14.146.194:39463)
I20260808 21:05:16.613005 12471 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.194@KRBTEST.COM'} at 127.14.146.194:46655
WARNING: no policy specified for kudu/127.14.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
Entry for principal kudu/127.14.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab.
I20260808 21:05:16.633219 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34555
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:16.715871 13051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:16.716157 13051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:16.716234 13051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:16.717370 13051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:16.717437 13051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:16.717483 13051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:05:16.719024 13051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.195.keytab
--principal=kudu/127.14.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:34555
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:16.719305 13051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:16.719578 13051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:16.724944 13059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:16.725035 13051 server_base.cc:1034] running on GCE node
W20260808 21:05:16.724963 13058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:16.724944 13065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:16.725359 13051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:16.725641 13051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:16.726815 13051 hybrid_clock.cc:648] HybridClock initialized: now 1786223116726809 us; error 36 us; skew 500 ppm
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:16.730253 13051 init.cc:377] Logged in from keytab as kudu/127.14.146.195@KRBTEST.COM (short username kudu)
I20260808 21:05:16.730897 13051 webserver.cc:460] Webserver started at http://127.14.146.195:43147/ using document root <none> and password file <none>
I20260808 21:05:16.731178 13051 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:16.731225 13051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:16.731386 13051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:16.732975 13051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "6466ed392ba74d329de2a4f07421f6b9"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "8288bec8304419789f4bcbe80d683993"
server_key_iv: "b1c7287530435ed3f23f0d631adb9b98"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.733393 13051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "6466ed392ba74d329de2a4f07421f6b9"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "8288bec8304419789f4bcbe80d683993"
server_key_iv: "b1c7287530435ed3f23f0d631adb9b98"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.735610 13051 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 21:05:16.736788 13081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.737017 13051 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:05:16.737143 13051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "6466ed392ba74d329de2a4f07421f6b9"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "8288bec8304419789f4bcbe80d683993"
server_key_iv: "b1c7287530435ed3f23f0d631adb9b98"
server_key_version: "encryptionkey@0"
I20260808 21:05:16.737223 13051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:16.748466 13051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:16.750267 13051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:16.750382 13051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:16.750566 13051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:16.750898 13051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:16.750942 13051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.750988 13051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:16.751014 13051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:16.757156 13051 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:46405
I20260808 21:05:16.757242 13257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:46405 every 8 connection(s)
I20260808 21:05:16.757566 13051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:05:16.758598 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 13051
I20260808 21:05:16.758729 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:05:16.758965 14923 external_mini_cluster.cc:1428] Setting key a8a294e21a6e3352b561e1c2274213b9
Aug 08 21:05:16 dist-test-slave-t3q3 krb5kdc[12390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223116, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.195@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:16.767293 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.758567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:52887 (local address 127.14.146.254:34555)
0808 21:05:16.758647 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.758650 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.758882 (+ 232us) server_negotiation.cc:407] Connection header received
0808 21:05:16.759571 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.759572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.759584 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.759652 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:16.760815 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.761332 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.762316 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.762506 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.762586 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.764864 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:16.764865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:16.764865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:16.764871 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:16.766073 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.766454 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.766455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.766455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.766504 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.766717 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.766718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.766718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.766818 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:16.766870 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.767167 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.767228 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:05:16.767469 13262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.758523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:34555 (local address 127.14.146.195:52887)
0808 21:05:16.758738 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.758788 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:16.759425 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:16.759807 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:16.759812 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:16.760487 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:16.760693 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.760698 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.761412 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.761413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.762213 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.762215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.762602 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.762603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.762711 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.763262 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:16.763271 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:16.764771 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:16.766157 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:16.766164 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:16.766165 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:16.766384 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:16.766563 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:16.766563 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:16.766564 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:16.766661 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:16.766909 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:16.766915 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:16.767039 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 21:05:16.767134 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 21:05:16.767254 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":99,"threads_started":1}
I20260808 21:05:16.768013 13258 heartbeater.cc:347] Connected to a master server at 127.14.146.254:34555
I20260808 21:05:16.768157 13258 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:16.768361 13258 heartbeater.cc:511] Master 127.14.146.254:34555 requested a full tablet report, sending...
I20260808 21:05:16.768766 12471 ts_manager.cc:194] Registered new tserver with Master: 6466ed392ba74d329de2a4f07421f6b9 (127.14.146.195:46405)
I20260808 21:05:16.769155 12471 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.146.195@KRBTEST.COM'} at 127.14.146.195:52887
I20260808 21:05:16.770934 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:05:16.778574 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.772498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48670 (local address 127.14.146.254:34555)
0808 21:05:16.772584 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.772586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.772682 (+ 96us) server_negotiation.cc:407] Connection header received
0808 21:05:16.772748 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.772750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.772759 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.772815 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:16.773382 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.773858 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.774599 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.774807 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.774884 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.776035 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:16.776036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:16.776036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:16.776043 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:16.777357 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.777737 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.777738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.777738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.777795 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:16.778015 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:16.778016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:16.778016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:16.778172 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:16.778282 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.778394 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.778473 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 21:05:16.780237 12471 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48670:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:05:16.782083 12471 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:05:16.788899 13281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.784746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34124 (local address 127.14.146.194:39463)
0808 21:05:16.785084 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.785088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.785096 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:05:16.785134 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.785136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.785151 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.785223 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:16.785483 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.786632 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.787829 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.788446 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.788535 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.788596 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.788772 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.788814 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":83,"threads_started":1}
I20260808 21:05:16.788885 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.784528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:39463 (local address 127.0.0.1:34124)
0808 21:05:16.784719 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.784769 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:16.784853 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:16.785316 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:16.785319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:16.785325 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:16.785396 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.785398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.786741 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.786742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.787730 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.787733 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.788543 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.788545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.788638 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.788652 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 21:05:16.788752 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 21:05:16.788806 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":6,"thread_start_us":53,"threads_started":1}
I20260808 21:05:16.789361 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.784568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44311 (local address 127.0.0.1:43008)
0808 21:05:16.784966 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.784975 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:16.785017 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:16.785563 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:16.785564 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:16.785567 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:16.785626 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.785628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.786547 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.786548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.788091 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.788092 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.789123 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.789124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.789191 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.789195 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:16.789259 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 21:05:16.789304 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":42,"thread_start_us":92,"threads_started":1}
I20260808 21:05:16.789414 13283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.785067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43008 (local address 127.14.146.193:44311)
0808 21:05:16.785361 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.785366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.785377 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:05:16.785422 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.785425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.785443 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.785571 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:16.785692 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.786436 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.788204 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.788995 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.789120 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.789179 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.789274 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.789319 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":98,"threads_started":1}
I20260808 21:05:16.789837 12936 tablet_service.cc:1467] Processing CreateTablet for tablet cd5f466decfb47b383f41d7b4bd2756d (DEFAULT_TABLE table=test-table [id=ebc509aa4c5f4a8f9c31937c177c12f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:16.790081 12707 tablet_service.cc:1467] Processing CreateTablet for tablet cd5f466decfb47b383f41d7b4bd2756d (DEFAULT_TABLE table=test-table [id=ebc509aa4c5f4a8f9c31937c177c12f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:16.790280 12936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5f466decfb47b383f41d7b4bd2756d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:16.790428 12707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5f466decfb47b383f41d7b4bd2756d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:16.792629 13277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.784541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:46405 (local address 127.0.0.1:49488)
0808 21:05:16.784813 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.784823 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:16.784872 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:16.785316 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:16.785319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:16.785322 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:16.785396 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.785399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.786734 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.786735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.788086 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.788090 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.792314 (+ 4224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.792315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.792441 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.792445 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:16.792490 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 21:05:16.792538 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":76,"thread_start_us":114,"threads_started":1}
I20260808 21:05:16.792804 13282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.784824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49488 (local address 127.14.146.195:46405)
0808 21:05:16.785028 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.785033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.785045 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:05:16.785114 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.785116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.785133 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.785223 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:16.785482 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.786611 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.788204 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.792211 (+ 4007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.792313 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.792636 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.792666 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.792722 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":94,"threads_started":1}
I20260808 21:05:16.793427 13163 tablet_service.cc:1467] Processing CreateTablet for tablet cd5f466decfb47b383f41d7b4bd2756d (DEFAULT_TABLE table=test-table [id=ebc509aa4c5f4a8f9c31937c177c12f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:16.793752 13163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5f466decfb47b383f41d7b4bd2756d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:16.794133 13285 tablet_bootstrap.cc:492] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: Bootstrap starting.
I20260808 21:05:16.794474 13286 tablet_bootstrap.cc:492] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4: Bootstrap starting.
I20260808 21:05:16.794865 13285 tablet_bootstrap.cc:654] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:16.795150 13286 tablet_bootstrap.cc:654] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:16.795462 13285 log.cc:824] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:16.795806 13286 log.cc:824] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:16.796603 13286 tablet_bootstrap.cc:492] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4: No bootstrap required, opened a new log
I20260808 21:05:16.796610 13285 tablet_bootstrap.cc:492] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: No bootstrap required, opened a new log
I20260808 21:05:16.796696 13285 ts_tablet_manager.cc:1397] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 21:05:16.796702 13286 ts_tablet_manager.cc:1397] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 21:05:16.797338 13290 tablet_bootstrap.cc:492] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: Bootstrap starting.
I20260808 21:05:16.798112 13290 tablet_bootstrap.cc:654] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:16.798255 13285 raft_consensus.cc:348] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.798394 13285 raft_consensus.cc:374] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:16.798424 13285 raft_consensus.cc:729] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f70e7388a04c4a6eaf87b252a2119a60, State: Initialized, Role: FOLLOWER
I20260808 21:05:16.798540 13285 consensus_queue.cc:260] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.798854 13285 ts_tablet_manager.cc:1428] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:16.799082 13290 log.cc:824] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:16.798978 13286 raft_consensus.cc:348] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.799222 13286 raft_consensus.cc:374] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:16.799276 13286 raft_consensus.cc:729] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348eb1154f2748f2a83626b5046628d4, State: Initialized, Role: FOLLOWER
I20260808 21:05:16.799417 13286 consensus_queue.cc:260] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.799741 13286 ts_tablet_manager.cc:1428] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 21:05:16.799870 13041 heartbeater.cc:503] Master 127.14.146.254:34555 was elected leader, sending a full tablet report...
I20260808 21:05:16.800171 13290 tablet_bootstrap.cc:492] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: No bootstrap required, opened a new log
I20260808 21:05:16.800240 13290 ts_tablet_manager.cc:1397] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 21:05:16.801903 13290 raft_consensus.cc:348] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.802029 13290 raft_consensus.cc:374] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:16.802062 13290 raft_consensus.cc:729] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6466ed392ba74d329de2a4f07421f6b9, State: Initialized, Role: FOLLOWER
I20260808 21:05:16.802181 13290 consensus_queue.cc:260] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.802423 13290 ts_tablet_manager.cc:1428] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:16.802475 13258 heartbeater.cc:503] Master 127.14.146.254:34555 was elected leader, sending a full tablet report...
I20260808 21:05:16.799758 12809 heartbeater.cc:503] Master 127.14.146.254:34555 was elected leader, sending a full tablet report...
I20260808 21:05:16.810417 13291 raft_consensus.cc:482] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:05:16.810491 13291 raft_consensus.cc:504] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.810770 13291 leader_election.cc:288] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6466ed392ba74d329de2a4f07421f6b9 (127.14.146.195:46405), 348eb1154f2748f2a83626b5046628d4 (127.14.146.193:44311)
I20260808 21:05:16.813449 13045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.810904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:46405 (local address 127.14.146.194:44067)
0808 21:05:16.810960 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.810972 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:16.811016 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:16.811173 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:16.811175 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:16.811176 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:16.811231 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.811232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.811850 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.811851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.812627 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.812629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.813175 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.813176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.813260 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.813264 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:16.813346 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 21:05:16.813385 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 21:05:16.813447 13282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.810989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:44067 (local address 127.14.146.195:46405)
0808 21:05:16.811035 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.811037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.811046 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:16.811067 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.811068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.811077 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.811160 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:16.811307 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.811764 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.812725 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.813097 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.813177 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.813185 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.813354 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.813389 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 21:05:16.813769 13296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.810978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44311 (local address 127.14.146.194:40399)
0808 21:05:16.811176 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.811187 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:16.811270 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:16.811424 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:16.811424 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:16.811426 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:16.811500 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.811502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.812136 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.812137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.812852 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:16.812854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.813520 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.813521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:16.813629 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.813634 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 21:05:16.813691 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 21:05:16.813718 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":80,"threads_started":1}
I20260808 21:05:16.813822 13283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.811029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:40399 (local address 127.14.146.193:44311)
0808 21:05:16.811093 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.811094 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.811256 (+ 162us) server_negotiation.cc:407] Connection header received
0808 21:05:16.811337 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.811338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.811347 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.811419 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:16.811572 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.812011 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.812943 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.813407 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.813475 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.813483 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.813717 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.813756 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 21:05:16.814013 13191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f466decfb47b383f41d7b4bd2756d" candidate_uuid: "f70e7388a04c4a6eaf87b252a2119a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6466ed392ba74d329de2a4f07421f6b9" is_pre_election: true
I20260808 21:05:16.814158 13191 raft_consensus.cc:2454] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f70e7388a04c4a6eaf87b252a2119a60 in term 0.
I20260808 21:05:16.814121 12741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f466decfb47b383f41d7b4bd2756d" candidate_uuid: "f70e7388a04c4a6eaf87b252a2119a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348eb1154f2748f2a83626b5046628d4" is_pre_election: true
I20260808 21:05:16.814265 12741 raft_consensus.cc:2454] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f70e7388a04c4a6eaf87b252a2119a60 in term 0.
I20260808 21:05:16.814376 12856 leader_election.cc:302] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6466ed392ba74d329de2a4f07421f6b9, f70e7388a04c4a6eaf87b252a2119a60; no voters:
I20260808 21:05:16.814519 13291 raft_consensus.cc:2781] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:05:16.814572 13291 raft_consensus.cc:482] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:05:16.814589 13291 raft_consensus.cc:3037] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:16.815163 13291 raft_consensus.cc:504] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.815299 13291 leader_election.cc:288] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [CANDIDATE]: Term 1 election: Requested vote from peers 6466ed392ba74d329de2a4f07421f6b9 (127.14.146.195:46405), 348eb1154f2748f2a83626b5046628d4 (127.14.146.193:44311)
I20260808 21:05:16.815447 13191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f466decfb47b383f41d7b4bd2756d" candidate_uuid: "f70e7388a04c4a6eaf87b252a2119a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6466ed392ba74d329de2a4f07421f6b9"
I20260808 21:05:16.815479 12741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f466decfb47b383f41d7b4bd2756d" candidate_uuid: "f70e7388a04c4a6eaf87b252a2119a60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348eb1154f2748f2a83626b5046628d4"
I20260808 21:05:16.815536 12741 raft_consensus.cc:3037] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:16.815526 13191 raft_consensus.cc:3037] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:16.816387 12741 raft_consensus.cc:2454] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f70e7388a04c4a6eaf87b252a2119a60 in term 1.
I20260808 21:05:16.816387 13191 raft_consensus.cc:2454] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f70e7388a04c4a6eaf87b252a2119a60 in term 1.
I20260808 21:05:16.816574 12851 leader_election.cc:302] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348eb1154f2748f2a83626b5046628d4, f70e7388a04c4a6eaf87b252a2119a60; no voters:
I20260808 21:05:16.816687 13291 raft_consensus.cc:2781] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:16.816828 13291 raft_consensus.cc:686] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 1 LEADER]: Becoming Leader. State: Replica: f70e7388a04c4a6eaf87b252a2119a60, State: Running, Role: LEADER
I20260808 21:05:16.816917 13291 consensus_queue.cc:237] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } }
I20260808 21:05:16.817692 12470 catalog_manager.cc:5495] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 reported cstate change: term changed from 0 to 1, leader changed from <none> to f70e7388a04c4a6eaf87b252a2119a60 (127.14.146.194). New cstate: current_term: 1 leader_uuid: "f70e7388a04c4a6eaf87b252a2119a60" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f70e7388a04c4a6eaf87b252a2119a60" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 39463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 } health_report { overall_health: UNKNOWN } } }
I20260808 21:05:16.825683 13281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.823289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34140 (local address 127.14.146.194:39463)
0808 21:05:16.823351 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:16.823353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:16.823362 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:16.823432 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:16.823432 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:16.823450 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:16.823520 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:16.823690 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.824213 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.824959 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:16.825143 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:16.825197 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:16.825367 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:16.825460 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:16.825519 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:16.825554 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 21:05:16.825569 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:05:16.827417 13191 raft_consensus.cc:1261] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 1 FOLLOWER]: Refusing update from remote peer f70e7388a04c4a6eaf87b252a2119a60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:16.827482 12741 raft_consensus.cc:1261] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 1 FOLLOWER]: Refusing update from remote peer f70e7388a04c4a6eaf87b252a2119a60: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:16.827787 13297 consensus_queue.cc:1035] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6466ed392ba74d329de2a4f07421f6b9" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 46405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:16.827916 13291 consensus_queue.cc:1035] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348eb1154f2748f2a83626b5046628d4" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 44311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:16.830324 13301 mvcc.cc:205] Tried to move back new op lower bound from 7316369886522355712 to 7316369886482903040. Current Snapshot: MvccSnapshot[applied={T|T < 7316369886522355712}]
I20260808 21:05:16.830459 13304 mvcc.cc:205] Tried to move back new op lower bound from 7316369886522355712 to 7316369886482903040. Current Snapshot: MvccSnapshot[applied={T|T < 7316369886522355712}]
I20260808 21:05:16.830790 13303 mvcc.cc:205] Tried to move back new op lower bound from 7316369886522355712 to 7316369886482903040. Current Snapshot: MvccSnapshot[applied={T|T < 7316369886522355712}]
I20260808 21:05:16.832432 12471 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:16.832528 12471 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48670:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:16.833266 12471 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2abe71cc809d4f00a947f14ca53e0564: Sending DeleteTablet for 3 replicas of tablet cd5f466decfb47b383f41d7b4bd2756d
I20260808 21:05:16.833563 12936 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5f466decfb47b383f41d7b4bd2756d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:16 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:34124
I20260808 21:05:16.833604 12707 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5f466decfb47b383f41d7b4bd2756d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:16 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:43008
I20260808 21:05:16.833659 13163 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5f466decfb47b383f41d7b4bd2756d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:16 UTC) from {username='kudu', principal='kudu/127.14.146.254@KRBTEST.COM'} at 127.0.0.1:49488
I20260808 21:05:16.833822 13317 tablet_replica.cc:330] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4: stopping tablet replica
I20260808 21:05:16.833850 13321 tablet_replica.cc:330] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: stopping tablet replica
I20260808 21:05:16.833909 13317 raft_consensus.cc:2229] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:16.833938 13321 raft_consensus.cc:2229] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:16.833997 13317 raft_consensus.cc:2258] T cd5f466decfb47b383f41d7b4bd2756d P 348eb1154f2748f2a83626b5046628d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:16.834030 13321 raft_consensus.cc:2258] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:16.834162 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 12586
I20260808 21:05:16.841327 13321 ts_tablet_manager.cc:1905] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:16.843012 13321 ts_tablet_manager.cc:1918] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:16.843086 13321 log.cc:1196] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/cd5f466decfb47b383f41d7b4bd2756d
I20260808 21:05:16.843382 13321 ts_tablet_manager.cc:1939] T cd5f466decfb47b383f41d7b4bd2756d P 6466ed392ba74d329de2a4f07421f6b9: Deleting consensus metadata
I20260808 21:05:16.843860 13316 tablet_replica.cc:330] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: stopping tablet replica
I20260808 21:05:16.843971 13316 raft_consensus.cc:2229] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:05:16.844658 13316 raft_consensus.cc:2258] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:16.846429 13316 ts_tablet_manager.cc:1905] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:16.850342 12452 catalog_manager.cc:4841] TS 6466ed392ba74d329de2a4f07421f6b9 (127.14.146.195:46405): tablet cd5f466decfb47b383f41d7b4bd2756d (table test-table [id=ebc509aa4c5f4a8f9c31937c177c12f1]) successfully deleted
I20260808 21:05:16.850481 13316 ts_tablet_manager.cc:1918] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:16.850569 13316 log.cc:1196] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/cd5f466decfb47b383f41d7b4bd2756d
I20260808 21:05:16.850852 13316 ts_tablet_manager.cc:1939] T cd5f466decfb47b383f41d7b4bd2756d P f70e7388a04c4a6eaf87b252a2119a60: Deleting consensus metadata
I20260808 21:05:16.851289 12451 catalog_manager.cc:4841] TS f70e7388a04c4a6eaf87b252a2119a60 (127.14.146.194:39463): tablet cd5f466decfb47b383f41d7b4bd2756d (table test-table [id=ebc509aa4c5f4a8f9c31937c177c12f1]) successfully deleted
W20260808 21:05:16.855113 12450 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:44311 (error 108)
I20260808 21:05:16.855327 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 12816
I20260808 21:05:16.862839 13277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:16.862659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:44311 (local address 127.0.0.1:43010)
0808 21:05:16.862744 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:16.862797 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:44311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 21:05:16.863487 12450 catalog_manager.cc:4584] TS 348eb1154f2748f2a83626b5046628d4 (127.14.146.193:44311): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cd5f466decfb47b383f41d7b4bd2756d: Network error: Client connection negotiation failed: client connection to 127.14.146.193:44311: connect: Connection refused (error 111)
I20260808 21:05:16.867733 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 13051
I20260808 21:05:16.874322 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 12412
2026-08-08T21:05:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2131 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T21:05:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:16Z Disabled control of system clock
I20260808 21:05:16.909595 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:33105
--webserver_interface=127.14.146.254
--webserver_port=0
--builtin_ntp_servers=127.14.146.212:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:33105
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 21:05:16.991781 13326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:16.991992 13326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:16.992012 13326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:16.993165 13326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:16.993208 13326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:16.993222 13326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:16.993234 13326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:16.993247 13326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:16.994571 13326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:33105
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:33105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:16.994769 13326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:16.994995 13326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:17.000120 13345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:17.000097 13337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:17.000344 13326 server_base.cc:1034] running on GCE node
W20260808 21:05:17.000090 13339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:17.000707 13326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:17.001006 13326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:17.002182 13326 hybrid_clock.cc:648] HybridClock initialized: now 1786223117002161 us; error 40 us; skew 500 ppm
I20260808 21:05:17.003340 13326 webserver.cc:460] Webserver started at http://127.14.146.254:33657/ using document root <none> and password file <none>
I20260808 21:05:17.003597 13326 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:17.003671 13326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:17.003821 13326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:17.004932 13326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "46a78c0adddc45de8c1ba733a93cdcd3"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "a779be81e2468a84dfad7d6f05c9df41"
server_key_iv: "fa6b124c9b821c27794ef2f20caf8661"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.005371 13326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "46a78c0adddc45de8c1ba733a93cdcd3"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "a779be81e2468a84dfad7d6f05c9df41"
server_key_iv: "fa6b124c9b821c27794ef2f20caf8661"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.006665 13326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 21:05:17.007349 13351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.007513 13326 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 21:05:17.007619 13326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "46a78c0adddc45de8c1ba733a93cdcd3"
format_stamp: "Formatted at 2026-08-08 21:05:16 on dist-test-slave-t3q3"
server_key: "a779be81e2468a84dfad7d6f05c9df41"
server_key_iv: "fa6b124c9b821c27794ef2f20caf8661"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.007699 13326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:17.030583 13326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:17.030915 13326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:17.031078 13326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:17.035411 13326 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:33105
I20260808 21:05:17.035447 13442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:33105 every 8 connection(s)
I20260808 21:05:17.035792 13326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:17.036798 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:17.039104 13443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3: Bootstrap starting.
I20260808 21:05:17.039705 13443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:17.040016 13443 log.cc:824] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:17.040725 13443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3: No bootstrap required, opened a new log
I20260808 21:05:17.042263 13443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46a78c0adddc45de8c1ba733a93cdcd3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33105 } }
I20260808 21:05:17.042399 13443 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:17.042421 13443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a78c0adddc45de8c1ba733a93cdcd3, State: Initialized, Role: FOLLOWER
I20260808 21:05:17.042557 13443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46a78c0adddc45de8c1ba733a93cdcd3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33105 } }
I20260808 21:05:17.042649 13443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:17.042675 13443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:17.042702 13443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:17.043171 13443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46a78c0adddc45de8c1ba733a93cdcd3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33105 } }
I20260808 21:05:17.043255 13443 leader_election.cc:302] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46a78c0adddc45de8c1ba733a93cdcd3; no voters:
I20260808 21:05:17.043394 13443 leader_election.cc:288] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:17.043455 13447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:17.043641 13447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [term 1 LEADER]: Becoming Leader. State: Replica: 46a78c0adddc45de8c1ba733a93cdcd3, State: Running, Role: LEADER
I20260808 21:05:17.043699 13443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:17.043748 13447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46a78c0adddc45de8c1ba733a93cdcd3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33105 } }
I20260808 21:05:17.044188 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 13326
I20260808 21:05:17.044317 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:17.044545 14923 external_mini_cluster.cc:1428] Setting key 8d5394abc86ca0aef58757452fe3f56b
I20260808 21:05:17.044894 13451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46a78c0adddc45de8c1ba733a93cdcd3. Latest consensus state: current_term: 1 leader_uuid: "46a78c0adddc45de8c1ba733a93cdcd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46a78c0adddc45de8c1ba733a93cdcd3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33105 } } }
I20260808 21:05:17.045003 13451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:17.045125 13450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46a78c0adddc45de8c1ba733a93cdcd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46a78c0adddc45de8c1ba733a93cdcd3" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33105 } } }
I20260808 21:05:17.045243 13471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:17.045260 13450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:17.046046 13471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:17.047623 13471 catalog_manager.cc:1347] Generated new cluster ID: 13fe117c72954c778ae2c768e8ed6279
I20260808 21:05:17.047678 13471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:17.050374 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.045217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57560 (local address 127.14.146.254:33105)
0808 21:05:17.045428 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.045438 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.045611 (+ 173us) server_negotiation.cc:407] Connection header received
0808 21:05:17.045767 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.045773 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.045826 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.045978 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:17.046207 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.047505 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.048416 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.048838 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.048973 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.049706 (+ 733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:17.049710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:17.049711 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:17.049890 (+ 179us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:17.049927 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:17.049939 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:17.050015 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.050089 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.050171 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260808 21:05:17.074899 13471 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:17.075668 13471 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:17.086000 13471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3: Generated new TSK 0
I20260808 21:05:17.086225 13471 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:17.095521 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.193:0
--local_ip_for_outbound_sockets=127.14.146.193
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33105
--builtin_ntp_servers=127.14.146.212:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 21:05:17.184360 13484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:17.184583 13484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:17.184609 13484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:17.185784 13484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:17.185817 13484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:17.185842 13484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.193
I20260808 21:05:17.187137 13484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.146.193
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.193
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:17.187332 13484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:17.187585 13484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 21:05:17.192875 13484 server_base.cc:1034] running on GCE node
W20260808 21:05:17.192837 13496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:17.192827 13495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:17.192837 13499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:17.193252 13484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:17.193507 13484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:17.194653 13484 hybrid_clock.cc:648] HybridClock initialized: now 1786223117194643 us; error 29 us; skew 500 ppm
I20260808 21:05:17.195969 13484 webserver.cc:460] Webserver started at http://127.14.146.193:33083/ using document root <none> and password file <none>
I20260808 21:05:17.196342 13484 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:17.196431 13484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:17.196578 13484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:17.197659 13484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/data/instance:
uuid: "65f25a988c2042c9a61454d3bf422c3d"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "3ce0ade818ea626633397a5e3fb105bb"
server_key_iv: "1b4459548d0ce0facfae7b8e9c53dba7"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.198030 13484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance:
uuid: "65f25a988c2042c9a61454d3bf422c3d"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "3ce0ade818ea626633397a5e3fb105bb"
server_key_iv: "1b4459548d0ce0facfae7b8e9c53dba7"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.199375 13484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:17.200153 13511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.200332 13484 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:17.200448 13484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/wal
uuid: "65f25a988c2042c9a61454d3bf422c3d"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "3ce0ade818ea626633397a5e3fb105bb"
server_key_iv: "1b4459548d0ce0facfae7b8e9c53dba7"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.200547 13484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:17.238245 13484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:17.238615 13484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:17.238790 13484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:17.239043 13484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:17.239424 13484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:17.239481 13484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.239529 13484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:17.239560 13484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.246213 13484 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.193:46483
I20260808 21:05:17.246265 13681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.193:46483 every 8 connection(s)
I20260808 21:05:17.246616 13484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/data/info.pb
I20260808 21:05:17.251991 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 13484
I20260808 21:05:17.252170 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-0/wal/instance
I20260808 21:05:17.252388 14923 external_mini_cluster.cc:1428] Setting key 16ca87c232c0484c19135074159b2f91
I20260808 21:05:17.252463 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.247502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.193:40953 (local address 127.14.146.254:33105)
0808 21:05:17.247571 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.247574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.247820 (+ 246us) server_negotiation.cc:407] Connection header received
0808 21:05:17.248457 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.248459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.248475 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.248541 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:17.249283 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.249809 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.250865 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.251076 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.251175 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.252128 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:17.252129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:17.252129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:17.252135 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:17.252152 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:17.252157 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:17.252229 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.252340 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.252382 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 21:05:17.252708 13691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.247488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:33105 (local address 127.14.146.193:40953)
0808 21:05:17.247691 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.247728 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:17.248343 (+ 615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:17.248627 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:17.248630 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:17.248640 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:17.249174 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.249178 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.249911 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.249912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.250760 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.250762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.251191 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.251192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.251341 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.251942 (+ 601us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:17.251943 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:17.251974 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:17.251999 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:17.252230 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:17.252237 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:17.252241 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:17.252328 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 21:05:17.252439 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260808 21:05:17.253235 13687 heartbeater.cc:347] Connected to a master server at 127.14.146.254:33105
I20260808 21:05:17.253360 13687 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:17.253552 13687 heartbeater.cc:511] Master 127.14.146.254:33105 requested a full tablet report, sending...
I20260808 21:05:17.253546 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.194:0
--local_ip_for_outbound_sockets=127.14.146.194
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33105
--builtin_ntp_servers=127.14.146.212:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 21:05:17.254098 13379 ts_manager.cc:194] Registered new tserver with Master: 65f25a988c2042c9a61454d3bf422c3d (127.14.146.193:46483)
I20260808 21:05:17.254720 13379 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.193:40953
W20260808 21:05:17.340487 13693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:17.340716 13693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:17.340755 13693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:17.341885 13693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:17.341951 13693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:17.341995 13693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.194
I20260808 21:05:17.343477 13693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.146.194
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.194
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:17.343739 13693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:17.344166 13693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:17.349525 13713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:17.349583 13708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:17.349521 13710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:17.349786 13693 server_base.cc:1034] running on GCE node
I20260808 21:05:17.350033 13693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:17.350332 13693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:17.351507 13693 hybrid_clock.cc:648] HybridClock initialized: now 1786223117351494 us; error 41 us; skew 500 ppm
I20260808 21:05:17.352843 13693 webserver.cc:460] Webserver started at http://127.14.146.194:33059/ using document root <none> and password file <none>
I20260808 21:05:17.353150 13693 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:17.353227 13693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:17.353394 13693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:17.354452 13693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/data/instance:
uuid: "0dce364c43d44d43bdc319ce4d3923fe"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "78888b437c8495dc135686942f2e305e"
server_key_iv: "b5b5e0106797e61f9f4ece051e349854"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.354816 13693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance:
uuid: "0dce364c43d44d43bdc319ce4d3923fe"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "78888b437c8495dc135686942f2e305e"
server_key_iv: "b5b5e0106797e61f9f4ece051e349854"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.356178 13693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:17.356902 13722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.357085 13693 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:17.357189 13693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/wal
uuid: "0dce364c43d44d43bdc319ce4d3923fe"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "78888b437c8495dc135686942f2e305e"
server_key_iv: "b5b5e0106797e61f9f4ece051e349854"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.357277 13693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:17.390559 13693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:17.390915 13693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:17.391084 13693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:17.391338 13693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:17.391707 13693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:17.391767 13693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.391808 13693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:17.391839 13693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.397694 13693 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.194:33843
I20260808 21:05:17.397742 13925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.194:33843 every 8 connection(s)
I20260808 21:05:17.398094 13693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/data/info.pb
I20260808 21:05:17.399909 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 13693
I20260808 21:05:17.400018 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/wal/instance
I20260808 21:05:17.400291 14923 external_mini_cluster.cc:1428] Setting key 52a2a16956aebff6397cacbe05041a74
I20260808 21:05:17.401645 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.146.195:0
--local_ip_for_outbound_sockets=127.14.146.195
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33105
--builtin_ntp_servers=127.14.146.212:39487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 21:05:17.404681 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.398907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:55555 (local address 127.14.146.254:33105)
0808 21:05:17.399042 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.399054 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.399239 (+ 185us) server_negotiation.cc:407] Connection header received
0808 21:05:17.399835 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.399837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.399847 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.399914 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:17.401026 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.401587 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.403067 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.403328 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.403422 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.404369 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:17.404371 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:17.404371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:17.404376 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:17.404392 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:17.404396 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:17.404467 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.404567 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.404594 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260808 21:05:17.404906 13929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.398856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:33105 (local address 127.14.146.194:55555)
0808 21:05:17.399106 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.399148 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:17.399712 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:17.399985 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:17.399990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:17.400004 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:17.400928 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.400935 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.401684 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.401686 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.402984 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.402988 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.403431 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.403433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.403578 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.404154 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:17.404155 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:17.404184 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:17.404207 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:17.404469 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:17.404475 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:17.404479 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:17.404569 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 21:05:17.404672 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":92,"threads_started":1}
I20260808 21:05:17.405354 13926 heartbeater.cc:347] Connected to a master server at 127.14.146.254:33105
I20260808 21:05:17.405434 13926 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:17.405578 13926 heartbeater.cc:511] Master 127.14.146.254:33105 requested a full tablet report, sending...
I20260808 21:05:17.405944 13379 ts_manager.cc:194] Registered new tserver with Master: 0dce364c43d44d43bdc319ce4d3923fe (127.14.146.194:33843)
I20260808 21:05:17.406265 13379 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.194:55555
W20260808 21:05:17.486166 13930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:17.486413 13930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:17.486449 13930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:17.487578 13930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:17.487644 13930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:17.487684 13930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.146.195
I20260808 21:05:17.489113 13930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:39487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.146.195
--webserver_port=0
--tserver_master_addrs=127.14.146.254:33105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.146.195
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:17.489380 13930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:17.489683 13930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:17.495010 13946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:17.494987 13947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:17.495002 13950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:17.495289 13930 server_base.cc:1034] running on GCE node
I20260808 21:05:17.495527 13930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:17.495801 13930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:17.496981 13930 hybrid_clock.cc:648] HybridClock initialized: now 1786223117496963 us; error 29 us; skew 500 ppm
I20260808 21:05:17.498373 13930 webserver.cc:460] Webserver started at http://127.14.146.195:33565/ using document root <none> and password file <none>
I20260808 21:05:17.498575 13930 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:17.498623 13930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:17.498714 13930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:17.499714 13930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/data/instance:
uuid: "0cc3f336119a44788d6f458ffa16fcf0"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "6d82b1a0b5598e223e0c1e37505f10b6"
server_key_iv: "2d31ab50bd2c21ac8e2d5b35083af81b"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.500017 13930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance:
uuid: "0cc3f336119a44788d6f458ffa16fcf0"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "6d82b1a0b5598e223e0c1e37505f10b6"
server_key_iv: "2d31ab50bd2c21ac8e2d5b35083af81b"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.501336 13930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:17.502060 13959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.502254 13930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:17.502346 13930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/wal
uuid: "0cc3f336119a44788d6f458ffa16fcf0"
format_stamp: "Formatted at 2026-08-08 21:05:17 on dist-test-slave-t3q3"
server_key: "6d82b1a0b5598e223e0c1e37505f10b6"
server_key_iv: "2d31ab50bd2c21ac8e2d5b35083af81b"
server_key_version: "encryptionkey@0"
I20260808 21:05:17.502403 13930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:17.510769 13930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:17.511073 13930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:17.511180 13930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:17.511345 13930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 21:05:17.511610 13930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 21:05:17.511649 13930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.511670 13930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 21:05:17.511682 13930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:17.517287 13930 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.195:37763
I20260808 21:05:17.517360 14154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.195:37763 every 8 connection(s)
I20260808 21:05:17.517709 13930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/data/info.pb
I20260808 21:05:17.518008 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 13930
I20260808 21:05:17.518118 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/wal/instance
I20260808 21:05:17.518371 14923 external_mini_cluster.cc:1428] Setting key 47a89b8a9f73a4081426341d7a753a9c
I20260808 21:05:17.523161 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.518606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.195:42125 (local address 127.14.146.254:33105)
0808 21:05:17.518676 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.518679 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.518921 (+ 242us) server_negotiation.cc:407] Connection header received
0808 21:05:17.519420 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.519421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.519432 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.519473 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:17.520269 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.520814 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.521782 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.521983 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.522048 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.522832 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:17.522834 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:17.522834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:17.522839 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:17.522854 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:17.522858 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:17.522905 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.523069 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.523100 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 21:05:17.523392 14162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.518608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:33105 (local address 127.14.146.195:42125)
0808 21:05:17.518804 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.518845 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:17.519326 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:17.519544 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:17.519548 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:17.519556 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:17.520158 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.520163 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.520897 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.520898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.521696 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.521698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.522067 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.522068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.522195 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.522700 (+ 505us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 21:05:17.522700 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:17.522728 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 21:05:17.522750 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:17.522953 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:17.522961 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:17.522964 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 21:05:17.523060 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 21:05:17.523148 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260808 21:05:17.523886 14155 heartbeater.cc:347] Connected to a master server at 127.14.146.254:33105
I20260808 21:05:17.524006 14155 heartbeater.cc:464] Registering TS with master...
I20260808 21:05:17.524216 14155 heartbeater.cc:511] Master 127.14.146.254:33105 requested a full tablet report, sending...
I20260808 21:05:17.524601 13379 ts_manager.cc:194] Registered new tserver with Master: 0cc3f336119a44788d6f458ffa16fcf0 (127.14.146.195:37763)
I20260808 21:05:17.524986 13379 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.146.195:42125
I20260808 21:05:17.530212 14923 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 21:05:17.534493 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.531698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.14.146.254:33105)
0808 21:05:17.531749 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.531752 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.531862 (+ 110us) server_negotiation.cc:407] Connection header received
0808 21:05:17.531912 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.531912 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.531924 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.531986 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:17.532205 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.532674 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.533468 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.533652 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.533707 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.534294 (+ 587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:17.534296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:17.534296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:17.534300 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:17.534315 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:17.534319 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:17.534362 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.534412 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.534435 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:05:17.536260 13379 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 21:05:17.537762 13379 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 21:05:17.544389 14179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.539954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:46483 (local address 127.0.0.1:46356)
0808 21:05:17.540094 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.540136 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:17.540198 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:17.540612 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:17.540616 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:17.540619 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:17.540699 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.540701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.541767 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.541791 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.542914 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.542917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.544084 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.544085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.544160 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.544184 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 21:05:17.544241 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 21:05:17.544280 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":68,"thread_start_us":69,"threads_started":1}
I20260808 21:05:17.544394 14182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.540317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48966 (local address 127.14.146.194:33843)
0808 21:05:17.540727 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.540731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.540742 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:05:17.540782 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.540784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.540799 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.540885 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:17.541044 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.541736 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.543206 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.543904 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.543972 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.544046 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.544215 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.544263 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":86,"threads_started":1}
I20260808 21:05:17.544503 14180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.540096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46356 (local address 127.14.146.193:46483)
0808 21:05:17.540375 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.540383 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.540394 (+ 11us) server_negotiation.cc:407] Connection header received
0808 21:05:17.540437 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.540439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.540456 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.540566 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:17.540955 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.541686 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.543023 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.543823 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.543903 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.544020 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.544363 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.544410 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":110,"threads_started":1}
I20260808 21:05:17.545243 13586 tablet_service.cc:1467] Processing CreateTablet for tablet b1e488695dce4aa09c162fe6e08ca915 (DEFAULT_TABLE table=test-table [id=0f465ef228834fc6a51e5433d2e4bed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:17.545706 13586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e488695dce4aa09c162fe6e08ca915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:17.546160 14185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.540432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57678 (local address 127.14.146.195:37763)
0808 21:05:17.542023 (+ 1591us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.542027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.542037 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:17.542074 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.542076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.542090 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.542176 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:17.542331 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.543467 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.545059 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.545803 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.545915 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.546003 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.546059 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.546103 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1552,"thread_start_us":89,"threads_started":1}
I20260808 21:05:17.546186 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.540328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:37763 (local address 127.0.0.1:57678)
0808 21:05:17.540589 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.540597 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:17.540632 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:17.542193 (+ 1561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:17.542194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:17.542197 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:17.542244 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.542246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.543549 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.543550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.544852 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.544856 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.545914 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.545915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.545977 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.545981 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:17.546046 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 21:05:17.546090 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":83,"threads_started":1}
I20260808 21:05:17.547115 14038 tablet_service.cc:1467] Processing CreateTablet for tablet b1e488695dce4aa09c162fe6e08ca915 (DEFAULT_TABLE table=test-table [id=0f465ef228834fc6a51e5433d2e4bed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:17.547432 14038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e488695dce4aa09c162fe6e08ca915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:17.544322 14183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.540205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:33843 (local address 127.0.0.1:48966)
0808 21:05:17.540459 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.540469 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:17.540517 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:17.540890 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:17.540891 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:17.540893 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:17.540932 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.540934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.541815 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.541816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.543111 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.543115 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.543986 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.543987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.544093 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.544109 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 21:05:17.544187 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 21:05:17.544237 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":2,"thread_start_us":41,"threads_started":1}
I20260808 21:05:17.548877 14188 tablet_bootstrap.cc:492] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d: Bootstrap starting.
I20260808 21:05:17.549448 14188 tablet_bootstrap.cc:654] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:17.549762 14188 log.cc:824] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:17.550302 14190 tablet_bootstrap.cc:492] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: Bootstrap starting.
I20260808 21:05:17.550741 14188 tablet_bootstrap.cc:492] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d: No bootstrap required, opened a new log
I20260808 21:05:17.550943 14188 ts_tablet_manager.cc:1397] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:17.550992 14190 tablet_bootstrap.cc:654] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:17.550881 13803 tablet_service.cc:1467] Processing CreateTablet for tablet b1e488695dce4aa09c162fe6e08ca915 (DEFAULT_TABLE table=test-table [id=0f465ef228834fc6a51e5433d2e4bed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 21:05:17.551231 13803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1e488695dce4aa09c162fe6e08ca915. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:17.551296 14190 log.cc:824] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:17.552107 14190 tablet_bootstrap.cc:492] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: No bootstrap required, opened a new log
I20260808 21:05:17.552177 14190 ts_tablet_manager.cc:1397] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:17.553720 14188 raft_consensus.cc:348] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.553898 14188 raft_consensus.cc:374] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:17.553951 14188 raft_consensus.cc:729] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f25a988c2042c9a61454d3bf422c3d, State: Initialized, Role: FOLLOWER
I20260808 21:05:17.554070 14188 consensus_queue.cc:260] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.554184 14194 tablet_bootstrap.cc:492] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: Bootstrap starting.
I20260808 21:05:17.554658 14188 ts_tablet_manager.cc:1428] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260808 21:05:17.554706 13687 heartbeater.cc:503] Master 127.14.146.254:33105 was elected leader, sending a full tablet report...
I20260808 21:05:17.554767 14194 tablet_bootstrap.cc:654] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:17.554785 14190 raft_consensus.cc:348] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.554894 14190 raft_consensus.cc:374] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:17.554913 14190 raft_consensus.cc:729] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc3f336119a44788d6f458ffa16fcf0, State: Initialized, Role: FOLLOWER
I20260808 21:05:17.555056 14190 consensus_queue.cc:260] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.555085 14194 log.cc:824] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:17.555328 14190 ts_tablet_manager.cc:1428] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 21:05:17.555368 14155 heartbeater.cc:503] Master 127.14.146.254:33105 was elected leader, sending a full tablet report...
I20260808 21:05:17.555989 14194 tablet_bootstrap.cc:492] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: No bootstrap required, opened a new log
I20260808 21:05:17.556109 14194 ts_tablet_manager.cc:1397] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:17.557936 14194 raft_consensus.cc:348] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.558085 14194 raft_consensus.cc:374] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:17.558136 14194 raft_consensus.cc:729] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dce364c43d44d43bdc319ce4d3923fe, State: Initialized, Role: FOLLOWER
I20260808 21:05:17.558254 14194 consensus_queue.cc:260] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.558527 14194 ts_tablet_manager.cc:1428] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:17.558578 13926 heartbeater.cc:503] Master 127.14.146.254:33105 was elected leader, sending a full tablet report...
I20260808 21:05:17.592746 14201 raft_consensus.cc:482] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 21:05:17.592877 14201 raft_consensus.cc:504] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.593209 14201 leader_election.cc:288] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65f25a988c2042c9a61454d3bf422c3d (127.14.146.193:46483), 0cc3f336119a44788d6f458ffa16fcf0 (127.14.146.195:37763)
I20260808 21:05:17.596102 14180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.593497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:54193 (local address 127.14.146.193:46483)
0808 21:05:17.593558 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.593560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.593574 (+ 14us) server_negotiation.cc:407] Connection header received
0808 21:05:17.593609 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.593610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.593632 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.593700 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:17.593867 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.594356 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.595319 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.595704 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.595795 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.595803 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.595967 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.596006 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 21:05:17.596103 13929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.593397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:46483 (local address 127.14.146.194:54193)
0808 21:05:17.593457 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.593469 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:17.593520 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:17.593708 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:17.593710 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:17.593712 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:17.593788 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.593790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.594447 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.594448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.595222 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.595223 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.595793 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.595794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.595875 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.595879 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:17.595958 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 21:05:17.596001 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 21:05:17.596300 14185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.593660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.146.194:34811 (local address 127.14.146.195:37763)
0808 21:05:17.593706 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.593708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.593810 (+ 102us) server_negotiation.cc:407] Connection header received
0808 21:05:17.593865 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.593865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.593874 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.593925 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 21:05:17.594086 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.594550 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.595488 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.595853 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.595957 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.595967 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.596160 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.596212 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:05:17.596424 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.593544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.195:37763 (local address 127.14.146.194:34811)
0808 21:05:17.593736 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.593745 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:17.593802 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:17.593926 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:17.593926 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:17.593927 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 21:05:17.594006 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.594008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.594638 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.594639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.595393 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:17.595394 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.595972 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.595974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:17.596049 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.596053 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 21:05:17.596145 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 21:05:17.596335 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":106,"threads_started":1}
I20260808 21:05:17.596733 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e488695dce4aa09c162fe6e08ca915" candidate_uuid: "0dce364c43d44d43bdc319ce4d3923fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f25a988c2042c9a61454d3bf422c3d" is_pre_election: true
I20260808 21:05:17.596836 14081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e488695dce4aa09c162fe6e08ca915" candidate_uuid: "0dce364c43d44d43bdc319ce4d3923fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc3f336119a44788d6f458ffa16fcf0" is_pre_election: true
I20260808 21:05:17.596902 13615 raft_consensus.cc:2454] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dce364c43d44d43bdc319ce4d3923fe in term 0.
I20260808 21:05:17.596994 14081 raft_consensus.cc:2454] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dce364c43d44d43bdc319ce4d3923fe in term 0.
I20260808 21:05:17.597157 13733 leader_election.cc:302] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dce364c43d44d43bdc319ce4d3923fe, 65f25a988c2042c9a61454d3bf422c3d; no voters:
I20260808 21:05:17.597295 14201 raft_consensus.cc:2781] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 21:05:17.597388 14201 raft_consensus.cc:482] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 21:05:17.597421 14201 raft_consensus.cc:3037] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:17.598160 14201 raft_consensus.cc:504] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.598304 14201 leader_election.cc:288] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [CANDIDATE]: Term 1 election: Requested vote from peers 65f25a988c2042c9a61454d3bf422c3d (127.14.146.193:46483), 0cc3f336119a44788d6f458ffa16fcf0 (127.14.146.195:37763)
I20260808 21:05:17.598515 13615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e488695dce4aa09c162fe6e08ca915" candidate_uuid: "0dce364c43d44d43bdc319ce4d3923fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f25a988c2042c9a61454d3bf422c3d"
I20260808 21:05:17.598531 14081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1e488695dce4aa09c162fe6e08ca915" candidate_uuid: "0dce364c43d44d43bdc319ce4d3923fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc3f336119a44788d6f458ffa16fcf0"
I20260808 21:05:17.598606 14081 raft_consensus.cc:3037] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:17.598606 13615 raft_consensus.cc:3037] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:17.599550 14081 raft_consensus.cc:2454] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dce364c43d44d43bdc319ce4d3923fe in term 1.
I20260808 21:05:17.599550 13615 raft_consensus.cc:2454] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dce364c43d44d43bdc319ce4d3923fe in term 1.
I20260808 21:05:17.599728 13733 leader_election.cc:302] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc3f336119a44788d6f458ffa16fcf0, 0dce364c43d44d43bdc319ce4d3923fe; no voters:
I20260808 21:05:17.599829 14201 raft_consensus.cc:2781] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:17.600003 14201 raft_consensus.cc:686] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 1 LEADER]: Becoming Leader. State: Replica: 0dce364c43d44d43bdc319ce4d3923fe, State: Running, Role: LEADER
I20260808 21:05:17.600135 14201 consensus_queue.cc:237] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } }
I20260808 21:05:17.600979 13382 catalog_manager.cc:5495] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dce364c43d44d43bdc319ce4d3923fe (127.14.146.194). New cstate: current_term: 1 leader_uuid: "0dce364c43d44d43bdc319ce4d3923fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dce364c43d44d43bdc319ce4d3923fe" member_type: VOTER last_known_addr { host: "127.14.146.194" port: 33843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 } health_report { overall_health: UNKNOWN } } }
I20260808 21:05:17.619901 14182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.617435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48976 (local address 127.14.146.194:33843)
0808 21:05:17.617510 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:17.617512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:17.617521 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:17.617560 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:17.617561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:17.617580 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:17.617684 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:17.617824 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.618304 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.619070 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:17.619285 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:17.619365 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:17.619537 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:17.619659 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:17.619759 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:17.619778 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 21:05:17.619797 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 21:05:17.621955 13615 raft_consensus.cc:1261] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [term 1 FOLLOWER]: Refusing update from remote peer 0dce364c43d44d43bdc319ce4d3923fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:17.622002 14081 raft_consensus.cc:1261] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 1 FOLLOWER]: Refusing update from remote peer 0dce364c43d44d43bdc319ce4d3923fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:17.622392 14201 consensus_queue.cc:1035] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "65f25a988c2042c9a61454d3bf422c3d" member_type: VOTER last_known_addr { host: "127.14.146.193" port: 46483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:17.622550 14203 consensus_queue.cc:1035] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cc3f336119a44788d6f458ffa16fcf0" member_type: VOTER last_known_addr { host: "127.14.146.195" port: 37763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:17.624949 14209 mvcc.cc:205] Tried to move back new op lower bound from 7316369889776316416 to 7316369889690968064. Current Snapshot: MvccSnapshot[applied={T|T < 7316369889776316416}]
I20260808 21:05:17.625650 14212 mvcc.cc:205] Tried to move back new op lower bound from 7316369889776316416 to 7316369889690968064. Current Snapshot: MvccSnapshot[applied={T|T < 7316369889776316416}]
I20260808 21:05:17.625694 14210 mvcc.cc:205] Tried to move back new op lower bound from 7316369889776316416 to 7316369889690968064. Current Snapshot: MvccSnapshot[applied={T|T < 7316369889776316416 or (T in {7316369889776316416})}]
I20260808 21:05:17.627887 13382 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:17.627990 13382 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 21:05:17.628758 13382 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 46a78c0adddc45de8c1ba733a93cdcd3: Sending DeleteTablet for 3 replicas of tablet b1e488695dce4aa09c162fe6e08ca915
I20260808 21:05:17.629153 13586 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e488695dce4aa09c162fe6e08ca915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:17 UTC) from {username='slave'} at 127.0.0.1:46356
I20260808 21:05:17.629379 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 13484
I20260808 21:05:17.629388 14222 tablet_replica.cc:330] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d: stopping tablet replica
I20260808 21:05:17.629433 13803 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e488695dce4aa09c162fe6e08ca915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:17 UTC) from {username='slave'} at 127.0.0.1:48966
I20260808 21:05:17.629551 14222 raft_consensus.cc:2229] T b1e488695dce4aa09c162fe6e08ca915 P 65f25a988c2042c9a61454d3bf422c3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:17.629721 14038 tablet_service.cc:1514] Processing DeleteTablet for tablet b1e488695dce4aa09c162fe6e08ca915 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 21:05:17 UTC) from {username='slave'} at 127.0.0.1:57678
I20260808 21:05:17.640225 14225 tablet_replica.cc:330] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: stopping tablet replica
I20260808 21:05:17.640365 14225 raft_consensus.cc:2229] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 21:05:17.640455 14224 tablet_replica.cc:330] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: stopping tablet replica
I20260808 21:05:17.640498 14225 raft_consensus.cc:2258] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:17.640553 14224 raft_consensus.cc:2229] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 1 LEADER]: Raft consensus shutting down.
I20260808 21:05:17.640842 14224 raft_consensus.cc:2258] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 21:05:17.640957 14225 ts_tablet_manager.cc:1905] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 21:05:17.641306 14224 ts_tablet_manager.cc:1905] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 21:05:17.642665 13360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.146.193:46483 (error 108)
I20260808 21:05:17.642737 14225 ts_tablet_manager.cc:1918] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:17.642817 14225 log.cc:1196] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-2/wal/wals/b1e488695dce4aa09c162fe6e08ca915
I20260808 21:05:17.643018 14224 ts_tablet_manager.cc:1918] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 21:05:17.643091 14225 ts_tablet_manager.cc:1939] T b1e488695dce4aa09c162fe6e08ca915 P 0cc3f336119a44788d6f458ffa16fcf0: Deleting consensus metadata
I20260808 21:05:17.643113 14224 log.cc:1196] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: Deleting WAL directory at /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786222870463854-14923-0/minicluster-data/ts-1/wal/wals/b1e488695dce4aa09c162fe6e08ca915
I20260808 21:05:17.643404 14224 ts_tablet_manager.cc:1939] T b1e488695dce4aa09c162fe6e08ca915 P 0dce364c43d44d43bdc319ce4d3923fe: Deleting consensus metadata
I20260808 21:05:17.643472 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 13693
I20260808 21:05:17.648874 13360 catalog_manager.cc:4841] TS 0cc3f336119a44788d6f458ffa16fcf0 (127.14.146.195:37763): tablet b1e488695dce4aa09c162fe6e08ca915 (table test-table [id=0f465ef228834fc6a51e5433d2e4bed2]) successfully deleted
I20260808 21:05:17.648967 14183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.648813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.193:46483 (local address 127.0.0.1:46364)
0808 21:05:17.648865 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.648923 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.193:46483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 21:05:17.650205 13360 catalog_manager.cc:4584] TS 65f25a988c2042c9a61454d3bf422c3d (127.14.146.193:46483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b1e488695dce4aa09c162fe6e08ca915: Network error: Client connection negotiation failed: client connection to 127.14.146.193:46483: connect: Connection refused (error 111)
I20260808 21:05:17.654747 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 13930
I20260808 21:05:17.654793 14183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:17.654640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.194:33843 (local address 127.0.0.1:48982)
0808 21:05:17.654734 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:17.654764 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.194:33843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 21:05:17.674125 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 13326
2026-08-08T21:05:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (797 ms)
[----------] 6 tests from EncryptionPolicyTest (8962 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:17 dist-test-slave-t3q3 krb5kdc[14230](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:17 dist-test-slave-t3q3 krb5kdc[14230](info): set up 2 sockets
Aug 08 21:05:17 dist-test-slave-t3q3 krb5kdc[14230](info): commencing operation
krb5kdc: starting...
W20260808 21:05:18.958086 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:19 dist-test-slave-t3q3 krb5kdc[14230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:19.083031 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39283
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:19.166991 14250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:19.167188 14250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:19.167210 14250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:19.168282 14250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:19.168318 14250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:19.168331 14250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:19.168344 14250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:19.168356 14250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:19.169727 14250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39283
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:19.169911 14250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:19.170073 14250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:19.174981 14261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:19.175026 14264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:19.175026 14258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:19.175246 14250 server_base.cc:1034] running on GCE node
I20260808 21:05:19.175623 14250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:19.175902 14250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:19.177067 14250 hybrid_clock.cc:648] HybridClock initialized: now 1786223119177056 us; error 40 us; skew 500 ppm
Aug 08 21:05:19 dist-test-slave-t3q3 krb5kdc[14230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223119, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:19.182363 14250 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:19.182793 14250 webserver.cc:460] Webserver started at http://127.0.0.1:33111/ using document root <none> and password file <none>
I20260808 21:05:19.183025 14250 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:19.183099 14250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:19.183252 14250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:19.184360 14250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "be30464d1433454fb0100d8b7b727218"
format_stamp: "Formatted at 2026-08-08 21:05:19 on dist-test-slave-t3q3"
server_key: "8c22b419e3b57ae3c76b5229ad7fdb85"
server_key_iv: "098daf82cdb36cf62f8df963a2823415"
server_key_version: "encryptionkey@0"
I20260808 21:05:19.184729 14250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "be30464d1433454fb0100d8b7b727218"
format_stamp: "Formatted at 2026-08-08 21:05:19 on dist-test-slave-t3q3"
server_key: "8c22b419e3b57ae3c76b5229ad7fdb85"
server_key_iv: "098daf82cdb36cf62f8df963a2823415"
server_key_version: "encryptionkey@0"
I20260808 21:05:19.186051 14250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:05:19.186798 14278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:19.186964 14250 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:19.187067 14250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "be30464d1433454fb0100d8b7b727218"
format_stamp: "Formatted at 2026-08-08 21:05:19 on dist-test-slave-t3q3"
server_key: "8c22b419e3b57ae3c76b5229ad7fdb85"
server_key_iv: "098daf82cdb36cf62f8df963a2823415"
server_key_version: "encryptionkey@0"
I20260808 21:05:19.187151 14250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:19.195143 14250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:19.197324 14250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:19.197484 14250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:19.201387 14250 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39283
I20260808 21:05:19.201449 14370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39283 every 8 connection(s)
I20260808 21:05:19.201776 14250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:19.202625 14371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:19.204849 14371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218: Bootstrap starting.
I20260808 21:05:19.205408 14371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:19.205704 14371 log.cc:824] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:19.206419 14371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218: No bootstrap required, opened a new log
I20260808 21:05:19.207940 14371 raft_consensus.cc:348] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be30464d1433454fb0100d8b7b727218" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39283 } }
I20260808 21:05:19.208158 14371 raft_consensus.cc:374] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:19.208216 14371 raft_consensus.cc:729] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be30464d1433454fb0100d8b7b727218, State: Initialized, Role: FOLLOWER
I20260808 21:05:19.208364 14371 consensus_queue.cc:260] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be30464d1433454fb0100d8b7b727218" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39283 } }
I20260808 21:05:19.208427 14371 raft_consensus.cc:388] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:19.208447 14371 raft_consensus.cc:482] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:19.208536 14371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:19.208722 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 14250
I20260808 21:05:19.208874 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:19.209077 14923 external_mini_cluster.cc:1428] Setting key a6089e33c99f50c9ed4178038755f1af
I20260808 21:05:19.209219 14371 raft_consensus.cc:504] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be30464d1433454fb0100d8b7b727218" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39283 } }
I20260808 21:05:19.209347 14371 leader_election.cc:302] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be30464d1433454fb0100d8b7b727218; no voters:
I20260808 21:05:19.209511 14371 leader_election.cc:288] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:19.209533 14377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:19.209688 14377 raft_consensus.cc:686] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [term 1 LEADER]: Becoming Leader. State: Replica: be30464d1433454fb0100d8b7b727218, State: Running, Role: LEADER
I20260808 21:05:19.209767 14371 sys_catalog.cc:564] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:19.209771 14377 consensus_queue.cc:237] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be30464d1433454fb0100d8b7b727218" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39283 } }
I20260808 21:05:19.210143 14379 sys_catalog.cc:455] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be30464d1433454fb0100d8b7b727218" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be30464d1433454fb0100d8b7b727218" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39283 } } }
I20260808 21:05:19.210247 14379 sys_catalog.cc:458] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:19.210361 14383 sys_catalog.cc:455] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be30464d1433454fb0100d8b7b727218. Latest consensus state: current_term: 1 leader_uuid: "be30464d1433454fb0100d8b7b727218" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be30464d1433454fb0100d8b7b727218" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39283 } } }
I20260808 21:05:19.210475 14383 sys_catalog.cc:458] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:19.210817 14387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:19.211359 14387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:19.213279 14387 catalog_manager.cc:1347] Generated new cluster ID: 08970b810198466d96676ad726198e53
I20260808 21:05:19.213335 14387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:05:19 dist-test-slave-t3q3 krb5kdc[14230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 21:05:19.221470 14382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:19.209558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48475 (local address 127.0.0.1:39283)
0808 21:05:19.209911 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:19.209920 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:19.210065 (+ 145us) server_negotiation.cc:407] Connection header received
0808 21:05:19.210482 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:19.210490 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:19.210788 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:19.210955 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:19.211812 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:19.213137 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:19.214235 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:19.214809 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:19.214901 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:19.217704 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:19.217708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:19.217708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:19.217721 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:19.219684 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:19.220186 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:19.220190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:19.220190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:19.220310 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:19.220560 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:19.220561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:19.220561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:19.220885 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:19.221071 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:19.221155 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 21:05:19.221260 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":106,"threads_started":1}
I20260808 21:05:19.222596 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:19.235435 14382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:19.224054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45433 (local address 127.0.0.1:39283)
0808 21:05:19.224113 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:19.224115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:19.228256 (+ 4141us) server_negotiation.cc:407] Connection header received
0808 21:05:19.228287 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:19.228288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:19.228299 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:19.228369 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:19.228942 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:19.229740 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:19.230711 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:19.231049 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:19.231122 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:19.232554 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:19.232556 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:19.232556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:19.232563 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:19.234205 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:19.234600 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:19.234601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:19.234602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:19.234667 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:19.234895 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:19.234896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:19.234896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:19.235028 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:19.235131 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:19.235275 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 21:05:19.235340 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:05:19.251852 14387 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:19.252461 14387 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:19.259527 14387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be30464d1433454fb0100d8b7b727218: Generated new TSK 0
I20260808 21:05:19.259735 14387 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:19.262962 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 14250
W20260808 21:05:19.281152 14227 connection.cc:535] client connection to 127.0.0.1:39283 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39283): Connection reset by peer (error 104)
2026-08-08T21:05:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1596 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:19 dist-test-slave-t3q3 krb5kdc[14420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:19 dist-test-slave-t3q3 krb5kdc[14420](info): set up 2 sockets
Aug 08 21:05:19 dist-test-slave-t3q3 krb5kdc[14420](info): commencing operation
krb5kdc: starting...
W20260808 21:05:20.545668 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:20 dist-test-slave-t3q3 krb5kdc[14420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:20.671325 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35771
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35771
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:20.759799 14438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:20.760040 14438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:20.760106 14438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:20.761267 14438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:20.761339 14438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:20.761366 14438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:20.761399 14438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:20.761423 14438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:20.762894 14438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35771
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35771
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:20.763185 14438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:20.763422 14438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:20.768644 14445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:20.768689 14438 server_base.cc:1034] running on GCE node
W20260808 21:05:20.768656 14449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:20.768690 14451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:20.769134 14438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:20.769457 14438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:20.770642 14438 hybrid_clock.cc:648] HybridClock initialized: now 1786223120770639 us; error 42 us; skew 500 ppm
Aug 08 21:05:20 dist-test-slave-t3q3 krb5kdc[14420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223120, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:20.773347 14438 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:20.773878 14438 webserver.cc:460] Webserver started at http://127.0.0.1:40455/ using document root <none> and password file <none>
I20260808 21:05:20.774119 14438 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:20.774190 14438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:20.774353 14438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:20.775494 14438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "c78f12ec84294045bcd9d0b0958235aa"
format_stamp: "Formatted at 2026-08-08 21:05:20 on dist-test-slave-t3q3"
server_key: "26ce17300b83d504b858b123011e770c"
server_key_iv: "8e98535018982256f72b25c0cb6ccc9d"
server_key_version: "encryptionkey@0"
I20260808 21:05:20.775893 14438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "c78f12ec84294045bcd9d0b0958235aa"
format_stamp: "Formatted at 2026-08-08 21:05:20 on dist-test-slave-t3q3"
server_key: "26ce17300b83d504b858b123011e770c"
server_key_iv: "8e98535018982256f72b25c0cb6ccc9d"
server_key_version: "encryptionkey@0"
I20260808 21:05:20.777388 14438 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:05:20.778162 14462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:20.778348 14438 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:20.778462 14438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "c78f12ec84294045bcd9d0b0958235aa"
format_stamp: "Formatted at 2026-08-08 21:05:20 on dist-test-slave-t3q3"
server_key: "26ce17300b83d504b858b123011e770c"
server_key_iv: "8e98535018982256f72b25c0cb6ccc9d"
server_key_version: "encryptionkey@0"
I20260808 21:05:20.778541 14438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:20.808110 14438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:20.810138 14438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:20.810322 14438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:20.814659 14438 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35771
I20260808 21:05:20.814698 14558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35771 every 8 connection(s)
I20260808 21:05:20.815115 14438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:20.816016 14559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:20.817719 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 14438
I20260808 21:05:20.817888 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:20.818082 14923 external_mini_cluster.cc:1428] Setting key 0ce43d1a21a9ff2e92729b092b345d26
I20260808 21:05:20.818892 14559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa: Bootstrap starting.
I20260808 21:05:20.819643 14559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:20.819984 14559 log.cc:824] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:20.820880 14559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa: No bootstrap required, opened a new log
I20260808 21:05:20.823158 14559 raft_consensus.cc:348] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78f12ec84294045bcd9d0b0958235aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35771 } }
I20260808 21:05:20.823360 14559 raft_consensus.cc:374] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:20.823398 14559 raft_consensus.cc:729] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c78f12ec84294045bcd9d0b0958235aa, State: Initialized, Role: FOLLOWER
I20260808 21:05:20.823549 14559 consensus_queue.cc:260] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78f12ec84294045bcd9d0b0958235aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35771 } }
I20260808 21:05:20.823644 14559 raft_consensus.cc:388] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:20.823716 14559 raft_consensus.cc:482] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:20.823776 14559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:20.824460 14559 raft_consensus.cc:504] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78f12ec84294045bcd9d0b0958235aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35771 } }
I20260808 21:05:20.824630 14559 leader_election.cc:302] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c78f12ec84294045bcd9d0b0958235aa; no voters:
I20260808 21:05:20.824637 14563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:20.818693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34867 (local address 127.0.0.1:35771)
0808 21:05:20.818923 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:20.818933 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:20.818969 (+ 36us) server_negotiation.cc:407] Connection header received
0808 21:05:20.819571 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:20.819580 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:20.819660 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:20.819825 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:20.820014 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:20.821356 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:20.822146 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:20.822863 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:20.822982 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:20.823851 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:20.823855 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:20.823856 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:20.824114 (+ 258us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:20.824160 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:20.824172 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:20.824269 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:20.824357 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 21:05:20.824386 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":110,"threads_started":1}
I20260808 21:05:20.824838 14559 leader_election.cc:288] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:20.824878 14566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:20.825081 14559 sys_catalog.cc:564] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:20.825803 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:20.825073 14566 raft_consensus.cc:686] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [term 1 LEADER]: Becoming Leader. State: Replica: c78f12ec84294045bcd9d0b0958235aa, State: Running, Role: LEADER
I20260808 21:05:20.826735 14566 consensus_queue.cc:237] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78f12ec84294045bcd9d0b0958235aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35771 } }
I20260808 21:05:20.827330 14568 sys_catalog.cc:455] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c78f12ec84294045bcd9d0b0958235aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78f12ec84294045bcd9d0b0958235aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35771 } } }
I20260808 21:05:20.827425 14568 sys_catalog.cc:458] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:20.827795 14595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:20.827781 14569 sys_catalog.cc:455] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader c78f12ec84294045bcd9d0b0958235aa. Latest consensus state: current_term: 1 leader_uuid: "c78f12ec84294045bcd9d0b0958235aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c78f12ec84294045bcd9d0b0958235aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35771 } } }
I20260808 21:05:20.828334 14569 sys_catalog.cc:458] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:20.828450 14595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:20.830756 14563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:20.827168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40063 (local address 127.0.0.1:35771)
0808 21:05:20.827206 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:20.827208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:20.827317 (+ 109us) server_negotiation.cc:407] Connection header received
0808 21:05:20.827386 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:20.827386 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:20.827395 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:20.827438 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:20.827634 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:20.828356 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:20.829427 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:20.829718 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:20.829792 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:20.830509 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:20.830510 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:20.830511 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:20.830516 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:20.830532 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:20.830536 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:20.830606 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:20.830671 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 21:05:20.830682 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:05:20.832499 14595 catalog_manager.cc:1347] Generated new cluster ID: 9db1f67f555b4be98bd818913f448179
I20260808 21:05:20.832552 14595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:20.842664 14595 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:20.843405 14595 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:20.846704 14595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c78f12ec84294045bcd9d0b0958235aa: Generated new TSK 0
I20260808 21:05:20.846894 14595 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:20.849666 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 14438
W20260808 21:05:20.864279 14417 connection.cc:535] client connection to 127.0.0.1:35771 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35771): Connection reset by peer (error 104)
2026-08-08T21:05:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1583 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:20 dist-test-slave-t3q3 krb5kdc[14603](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:20 dist-test-slave-t3q3 krb5kdc[14603](info): set up 2 sockets
Aug 08 21:05:20 dist-test-slave-t3q3 krb5kdc[14603](info): commencing operation
krb5kdc: starting...
W20260808 21:05:22.129333 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:22 dist-test-slave-t3q3 krb5kdc[14603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:22.253230 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34411
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:22.335213 14632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:22.335414 14632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:22.335440 14632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:22.336695 14632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:22.336740 14632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:22.336755 14632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:22.336768 14632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:22.336817 14632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:22.338366 14632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34411
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:22.338630 14632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:22.338856 14632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:22.344588 14638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:22.344555 14639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:22.344630 14632 server_base.cc:1034] running on GCE node
W20260808 21:05:22.344566 14643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:22.345074 14632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:22.345373 14632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:22.346554 14632 hybrid_clock.cc:648] HybridClock initialized: now 1786223122346537 us; error 47 us; skew 500 ppm
Aug 08 21:05:22 dist-test-slave-t3q3 krb5kdc[14603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223122, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:22.349112 14632 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:22.349565 14632 webserver.cc:460] Webserver started at http://127.0.0.1:43887/ using document root <none> and password file <none>
I20260808 21:05:22.349757 14632 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:22.349798 14632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:22.349892 14632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:22.350885 14632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "c73fd253525e492b971a08c203276ab6"
format_stamp: "Formatted at 2026-08-08 21:05:22 on dist-test-slave-t3q3"
server_key: "61f7a75ee8ee5854adebbfda776a447f"
server_key_iv: "f0c39edd341bcbe843bd6516018c4405"
server_key_version: "encryptionkey@0"
I20260808 21:05:22.351194 14632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "c73fd253525e492b971a08c203276ab6"
format_stamp: "Formatted at 2026-08-08 21:05:22 on dist-test-slave-t3q3"
server_key: "61f7a75ee8ee5854adebbfda776a447f"
server_key_iv: "f0c39edd341bcbe843bd6516018c4405"
server_key_version: "encryptionkey@0"
I20260808 21:05:22.352512 14632 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:22.353261 14652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:22.353467 14632 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:22.353567 14632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "c73fd253525e492b971a08c203276ab6"
format_stamp: "Formatted at 2026-08-08 21:05:22 on dist-test-slave-t3q3"
server_key: "61f7a75ee8ee5854adebbfda776a447f"
server_key_iv: "f0c39edd341bcbe843bd6516018c4405"
server_key_version: "encryptionkey@0"
I20260808 21:05:22.353637 14632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:22.356927 14632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:22.359175 14632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:22.359334 14632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:22.363168 14632 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34411
I20260808 21:05:22.363217 14741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34411 every 8 connection(s)
I20260808 21:05:22.363629 14632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:22.364686 14742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:22.366888 14742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6: Bootstrap starting.
I20260808 21:05:22.367456 14742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:22.367740 14742 log.cc:824] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:22.368052 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 14632
I20260808 21:05:22.368264 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:22.368443 14923 external_mini_cluster.cc:1428] Setting key 4bdd8d74c2c4727e87c195f05d406e55
I20260808 21:05:22.368566 14742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6: No bootstrap required, opened a new log
I20260808 21:05:22.370362 14742 raft_consensus.cc:348] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73fd253525e492b971a08c203276ab6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34411 } }
I20260808 21:05:22.370532 14742 raft_consensus.cc:374] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:22.370571 14742 raft_consensus.cc:729] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c73fd253525e492b971a08c203276ab6, State: Initialized, Role: FOLLOWER
I20260808 21:05:22.370775 14742 consensus_queue.cc:260] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73fd253525e492b971a08c203276ab6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34411 } }
I20260808 21:05:22.370896 14742 raft_consensus.cc:388] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:22.370944 14742 raft_consensus.cc:482] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:22.370993 14742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:22.371711 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:22.368986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50481 (local address 127.0.0.1:34411)
0808 21:05:22.369184 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:22.369194 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:22.369229 (+ 35us) server_negotiation.cc:407] Connection header received
0808 21:05:22.370354 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:22.370363 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:22.370394 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:22.370515 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:22.371278 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:22.371282 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:22.371282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:22.371287 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:22.371338 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:22.371348 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:22.371429 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:22.371502 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 21:05:22.371544 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
I20260808 21:05:22.372188 14742 raft_consensus.cc:504] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73fd253525e492b971a08c203276ab6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34411 } }
I20260808 21:05:22.372298 14742 leader_election.cc:302] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c73fd253525e492b971a08c203276ab6; no voters:
I20260808 21:05:22.372458 14742 leader_election.cc:288] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:22.372479 14752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:22.372594 14752 raft_consensus.cc:686] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [term 1 LEADER]: Becoming Leader. State: Replica: c73fd253525e492b971a08c203276ab6, State: Running, Role: LEADER
I20260808 21:05:22.372638 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:22.372675 14752 consensus_queue.cc:237] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73fd253525e492b971a08c203276ab6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34411 } }
I20260808 21:05:22.372718 14742 sys_catalog.cc:564] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:22.373040 14753 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c73fd253525e492b971a08c203276ab6. Latest consensus state: current_term: 1 leader_uuid: "c73fd253525e492b971a08c203276ab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73fd253525e492b971a08c203276ab6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34411 } } }
I20260808 21:05:22.373060 14756 sys_catalog.cc:455] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c73fd253525e492b971a08c203276ab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c73fd253525e492b971a08c203276ab6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34411 } } }
I20260808 21:05:22.373189 14756 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:22.373383 14753 sys_catalog.cc:458] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:22.373581 14759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:22.374387 14759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:22.375882 14759 catalog_manager.cc:1347] Generated new cluster ID: fe3de73d124d4a209e2df0ae26b38c2a
I20260808 21:05:22.375938 14759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:22.376623 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:22.375417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43935 (local address 127.0.0.1:34411)
0808 21:05:22.375450 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:22.375452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:22.375670 (+ 218us) server_negotiation.cc:407] Connection header received
0808 21:05:22.375743 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:22.375744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:22.375749 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:22.375794 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:22.376408 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:22.376409 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:22.376410 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:22.376414 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:22.376426 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:22.376430 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:22.376457 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:22.376545 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 21:05:22.376557 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 21:05:22.414337 14759 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:22.414579 14759 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:22.417202 14759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c73fd253525e492b971a08c203276ab6: Generated new TSK 0
I20260808 21:05:22.417425 14759 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:22.419088 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 14632
2026-08-08T21:05:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1569 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:22 dist-test-slave-t3q3 krb5kdc[14802](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:22 dist-test-slave-t3q3 krb5kdc[14802](info): set up 2 sockets
Aug 08 21:05:22 dist-test-slave-t3q3 krb5kdc[14802](info): commencing operation
krb5kdc: starting...
W20260808 21:05:23.669134 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:23 dist-test-slave-t3q3 krb5kdc[14802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:23.792048 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34351
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:23.874027 14820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:23.874230 14820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:23.874253 14820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:23.875425 14820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:23.875469 14820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:23.875484 14820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:23.875497 14820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:23.875509 14820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:23.877082 14820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:23.877332 14820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:23.877573 14820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:23.882789 14832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:23.882774 14829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:23.882827 14820 server_base.cc:1034] running on GCE node
W20260808 21:05:23.882774 14835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:23.883296 14820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:23.883611 14820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:23.884779 14820 hybrid_clock.cc:648] HybridClock initialized: now 1786223123884775 us; error 37 us; skew 500 ppm
Aug 08 21:05:23 dist-test-slave-t3q3 krb5kdc[14802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223123, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:23.887318 14820 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:23.887712 14820 webserver.cc:460] Webserver started at http://127.0.0.1:35819/ using document root <none> and password file <none>
I20260808 21:05:23.887916 14820 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:23.887957 14820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:23.888046 14820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:23.889170 14820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "5db7f2a4dd3740c39754c14f46edd949"
format_stamp: "Formatted at 2026-08-08 21:05:23 on dist-test-slave-t3q3"
server_key: "56cbf9f8b77157d4999b60afd8826a01"
server_key_iv: "06effdec86ab8b0252d193accbc32180"
server_key_version: "encryptionkey@0"
I20260808 21:05:23.889485 14820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "5db7f2a4dd3740c39754c14f46edd949"
format_stamp: "Formatted at 2026-08-08 21:05:23 on dist-test-slave-t3q3"
server_key: "56cbf9f8b77157d4999b60afd8826a01"
server_key_iv: "06effdec86ab8b0252d193accbc32180"
server_key_version: "encryptionkey@0"
I20260808 21:05:23.890758 14820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:05:23.891525 14843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:23.891718 14820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:23.891812 14820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "5db7f2a4dd3740c39754c14f46edd949"
format_stamp: "Formatted at 2026-08-08 21:05:23 on dist-test-slave-t3q3"
server_key: "56cbf9f8b77157d4999b60afd8826a01"
server_key_iv: "06effdec86ab8b0252d193accbc32180"
server_key_version: "encryptionkey@0"
I20260808 21:05:23.891876 14820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:23.903294 14820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:23.905630 14820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:23.905761 14820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:23.909857 14820 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34351
I20260808 21:05:23.909929 14942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34351 every 8 connection(s)
I20260808 21:05:23.910286 14820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:23.911216 14944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:23.913666 14944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949: Bootstrap starting.
I20260808 21:05:23.914260 14944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:23.914569 14944 log.cc:824] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:23.915302 14944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949: No bootstrap required, opened a new log
I20260808 21:05:23.916947 14944 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db7f2a4dd3740c39754c14f46edd949" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34351 } }
I20260808 21:05:23.917115 14944 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:23.917157 14944 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5db7f2a4dd3740c39754c14f46edd949, State: Initialized, Role: FOLLOWER
I20260808 21:05:23.917321 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 14820
I20260808 21:05:23.917328 14944 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db7f2a4dd3740c39754c14f46edd949" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34351 } }
I20260808 21:05:23.917409 14944 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:23.917449 14944 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:23.917450 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:23.917502 14944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:23.917667 14923 external_mini_cluster.cc:1428] Setting key 7ce1d3d29d5b7dfeb3b14a85f2a8402b
I20260808 21:05:23.918155 14944 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db7f2a4dd3740c39754c14f46edd949" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34351 } }
I20260808 21:05:23.918335 14944 leader_election.cc:302] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5db7f2a4dd3740c39754c14f46edd949; no voters:
I20260808 21:05:23.918530 14944 leader_election.cc:288] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:23.918560 14952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:23.918676 14952 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [term 1 LEADER]: Becoming Leader. State: Replica: 5db7f2a4dd3740c39754c14f46edd949, State: Running, Role: LEADER
I20260808 21:05:23.918838 14944 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:23.918816 14952 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db7f2a4dd3740c39754c14f46edd949" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34351 } }
I20260808 21:05:23.919333 14958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5db7f2a4dd3740c39754c14f46edd949. Latest consensus state: current_term: 1 leader_uuid: "5db7f2a4dd3740c39754c14f46edd949" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db7f2a4dd3740c39754c14f46edd949" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34351 } } }
I20260808 21:05:23.919415 14958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:23.919612 14957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5db7f2a4dd3740c39754c14f46edd949" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5db7f2a4dd3740c39754c14f46edd949" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34351 } } }
I20260808 21:05:23.920014 14960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:23.920023 14957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:23.920598 14960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:23.922523 14960 catalog_manager.cc:1347] Generated new cluster ID: 0229670583034ec9be342fac0d6ec3a5
I20260808 21:05:23.922578 14960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:05:23 dist-test-slave-t3q3 krb5kdc[14802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 21:05:23.930243 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:23.918166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58945 (local address 127.0.0.1:34351)
0808 21:05:23.918352 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:23.918362 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:23.918399 (+ 37us) server_negotiation.cc:407] Connection header received
0808 21:05:23.918545 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:23.918554 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:23.918632 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:23.919585 (+ 953us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:23.919699 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:23.921205 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:23.922278 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:23.922882 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:23.922983 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:23.925822 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:23.925826 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:23.925827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:23.925839 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:23.928576 (+ 2737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:23.928966 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:23.928969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:23.928969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:23.929096 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:23.929300 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:23.929301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:23.929302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:23.929618 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:23.929797 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:23.929871 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 21:05:23.930027 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260808 21:05:23.931488 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:23.940310 14951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:23.933007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48811 (local address 127.0.0.1:34351)
0808 21:05:23.933043 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:23.933044 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:23.933177 (+ 133us) server_negotiation.cc:407] Connection header received
0808 21:05:23.933219 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:23.933220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:23.933246 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:23.933310 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:23.933893 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:23.934647 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:23.935614 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:23.935950 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:23.936023 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:23.937363 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:23.937365 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:23.937365 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:23.937372 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:23.938929 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:23.939309 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:23.939310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:23.939311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:23.939370 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:23.939568 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:23.939568 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:23.939569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:23.939706 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:23.939806 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:23.940150 (+ 344us) server_negotiation.cc:299] Negotiation successful
0808 21:05:23.940223 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 21:05:23.970818 14960 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:23.971438 14960 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:23.974558 14960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5db7f2a4dd3740c39754c14f46edd949: Generated new TSK 0
I20260808 21:05:23.974761 14960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:23.979532 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 14820
2026-08-08T21:05:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1557 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:24 dist-test-slave-t3q3 krb5kdc[15002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:24 dist-test-slave-t3q3 krb5kdc[15002](info): set up 2 sockets
Aug 08 21:05:24 dist-test-slave-t3q3 krb5kdc[15002](info): commencing operation
krb5kdc: starting...
W20260808 21:05:25.222095 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:25 dist-test-slave-t3q3 krb5kdc[15002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:25.344606 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40415
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40415
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:25.428311 15024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:25.428514 15024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:25.428537 15024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:25.429662 15024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:25.429703 15024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:25.429718 15024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:25.429730 15024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:25.429742 15024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:25.431164 15024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:25.431356 15024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:25.431521 15024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:25.436398 15034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:25.436398 15036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:25.436451 15032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:25.436772 15024 server_base.cc:1034] running on GCE node
I20260808 21:05:25.437057 15024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:25.437373 15024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:25.438539 15024 hybrid_clock.cc:648] HybridClock initialized: now 1786223125438533 us; error 36 us; skew 500 ppm
Aug 08 21:05:25 dist-test-slave-t3q3 krb5kdc[15002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223125, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:25.444360 15024 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:25.444808 15024 webserver.cc:460] Webserver started at http://127.0.0.1:39133/ using document root <none> and password file <none>
I20260808 21:05:25.445047 15024 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:25.445118 15024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:25.445283 15024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:25.446358 15024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "5efff2835c2a4bbfbfc474074947e2ec"
format_stamp: "Formatted at 2026-08-08 21:05:25 on dist-test-slave-t3q3"
server_key: "87dccd41170ef0cdac94854f786cfc40"
server_key_iv: "0c218bdd07a30a98df8cc71f21226cbd"
server_key_version: "encryptionkey@0"
I20260808 21:05:25.446738 15024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "5efff2835c2a4bbfbfc474074947e2ec"
format_stamp: "Formatted at 2026-08-08 21:05:25 on dist-test-slave-t3q3"
server_key: "87dccd41170ef0cdac94854f786cfc40"
server_key_iv: "0c218bdd07a30a98df8cc71f21226cbd"
server_key_version: "encryptionkey@0"
I20260808 21:05:25.448217 15024 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:25.448987 15052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:25.449203 15024 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:25.449312 15024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "5efff2835c2a4bbfbfc474074947e2ec"
format_stamp: "Formatted at 2026-08-08 21:05:25 on dist-test-slave-t3q3"
server_key: "87dccd41170ef0cdac94854f786cfc40"
server_key_iv: "0c218bdd07a30a98df8cc71f21226cbd"
server_key_version: "encryptionkey@0"
I20260808 21:05:25.449405 15024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:25.483759 15024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:25.485745 15024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:25.485917 15024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:25.490060 15024 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40415
I20260808 21:05:25.490100 15146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40415 every 8 connection(s)
I20260808 21:05:25.490471 15024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:25.491366 15147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:25.493681 15147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec: Bootstrap starting.
I20260808 21:05:25.494217 15147 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:25.494448 15147 log.cc:824] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:25.495131 15147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec: No bootstrap required, opened a new log
I20260808 21:05:25.496717 15147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5efff2835c2a4bbfbfc474074947e2ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40415 } }
I20260808 21:05:25.496853 15147 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:25.496876 15147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5efff2835c2a4bbfbfc474074947e2ec, State: Initialized, Role: FOLLOWER
I20260808 21:05:25.496975 15147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5efff2835c2a4bbfbfc474074947e2ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40415 } }
I20260808 21:05:25.497025 15147 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:25.497045 15147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:25.497071 15147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:25.497535 15147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5efff2835c2a4bbfbfc474074947e2ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40415 } }
I20260808 21:05:25.497619 15147 leader_election.cc:302] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5efff2835c2a4bbfbfc474074947e2ec; no voters:
I20260808 21:05:25.497743 15147 leader_election.cc:288] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:25.497813 15150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:25.497961 15150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [term 1 LEADER]: Becoming Leader. State: Replica: 5efff2835c2a4bbfbfc474074947e2ec, State: Running, Role: LEADER
I20260808 21:05:25.498005 15147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:25.498051 15150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5efff2835c2a4bbfbfc474074947e2ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40415 } }
I20260808 21:05:25.498421 15152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5efff2835c2a4bbfbfc474074947e2ec. Latest consensus state: current_term: 1 leader_uuid: "5efff2835c2a4bbfbfc474074947e2ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5efff2835c2a4bbfbfc474074947e2ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40415 } } }
I20260808 21:05:25.498509 15152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:25.498549 15151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5efff2835c2a4bbfbfc474074947e2ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5efff2835c2a4bbfbfc474074947e2ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40415 } } }
I20260808 21:05:25.498608 15151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:25.498769 15159 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:25.499328 15159 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:25.500197 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15024
I20260808 21:05:25.500342 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:25.500567 14923 external_mini_cluster.cc:1428] Setting key adf6e76b3d24dae786beaf655246d66a
I20260808 21:05:25.501667 15159 catalog_manager.cc:1347] Generated new cluster ID: 0b7e6d98f13e4e518652095dddc39ca4
I20260808 21:05:25.501731 15159 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:25.507169 15180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:25.501061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42583 (local address 127.0.0.1:40415)
0808 21:05:25.501740 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:25.501748 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:25.501788 (+ 40us) server_negotiation.cc:407] Connection header received
0808 21:05:25.501907 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:25.501914 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:25.501966 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:25.502108 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:25.502351 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:25.503798 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:25.504940 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:25.505602 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:25.505729 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:25.506402 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:25.506406 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:25.506406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:25.506684 (+ 278us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:25.506731 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:25.506747 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:25.506823 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:25.506902 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 21:05:25.506967 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":69,"threads_started":1}
I20260808 21:05:25.508090 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:25.508332 15159 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:25.509033 15159 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:25.513062 15180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:25.509586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42441 (local address 127.0.0.1:40415)
0808 21:05:25.509622 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:25.509624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:25.509761 (+ 137us) server_negotiation.cc:407] Connection header received
0808 21:05:25.509806 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:25.509807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:25.509817 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:25.509865 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:25.509987 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:25.510710 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:25.511803 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:25.512121 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:25.512181 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:25.512814 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:25.512816 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:25.512816 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:25.512820 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:25.512833 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:25.512837 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:25.512887 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:25.512948 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 21:05:25.512974 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:05:25.517015 15159 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5efff2835c2a4bbfbfc474074947e2ec: Generated new TSK 0
I20260808 21:05:25.517210 15159 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:25.521016 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15024
2026-08-08T21:05:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1538 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:25 dist-test-slave-t3q3 krb5kdc[15191](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:25 dist-test-slave-t3q3 krb5kdc[15191](info): set up 2 sockets
Aug 08 21:05:25 dist-test-slave-t3q3 krb5kdc[15191](info): commencing operation
krb5kdc: starting...
W20260808 21:05:26.768700 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:26 dist-test-slave-t3q3 krb5kdc[15191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:26.894793 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34623
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:26.979135 15212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:26.979357 15212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:26.979379 15212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:26.980535 15212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:26.980576 15212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:26.980589 15212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:26.980602 15212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:26.980613 15212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:26.982061 15212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:26.982270 15212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:26.982455 15212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:26.987634 15224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:26.987640 15221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:26.987771 15222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:26.987851 15212 server_base.cc:1034] running on GCE node
I20260808 21:05:26.988242 15212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:26.988584 15212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:26.989734 15212 hybrid_clock.cc:648] HybridClock initialized: now 1786223126989711 us; error 38 us; skew 500 ppm
Aug 08 21:05:26 dist-test-slave-t3q3 krb5kdc[15191](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223126, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:26.992342 15212 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:26.992805 15212 webserver.cc:460] Webserver started at http://127.0.0.1:37547/ using document root <none> and password file <none>
I20260808 21:05:26.993083 15212 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:26.993156 15212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:26.993315 15212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:26.994410 15212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "99923706d2474461978f1094e164dd5b"
format_stamp: "Formatted at 2026-08-08 21:05:26 on dist-test-slave-t3q3"
server_key: "9c71371088aea93f8f32ed4f275fe970"
server_key_iv: "d054c2ab4d7fccc100264bb57a0f310e"
server_key_version: "encryptionkey@0"
I20260808 21:05:26.994796 15212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "99923706d2474461978f1094e164dd5b"
format_stamp: "Formatted at 2026-08-08 21:05:26 on dist-test-slave-t3q3"
server_key: "9c71371088aea93f8f32ed4f275fe970"
server_key_iv: "d054c2ab4d7fccc100264bb57a0f310e"
server_key_version: "encryptionkey@0"
I20260808 21:05:26.996366 15212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:26.997195 15238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:26.997407 15212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:26.997512 15212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "99923706d2474461978f1094e164dd5b"
format_stamp: "Formatted at 2026-08-08 21:05:26 on dist-test-slave-t3q3"
server_key: "9c71371088aea93f8f32ed4f275fe970"
server_key_iv: "d054c2ab4d7fccc100264bb57a0f310e"
server_key_version: "encryptionkey@0"
I20260808 21:05:26.997630 15212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:27.001211 15212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:27.003214 15212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:27.003377 15212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:27.007539 15212 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34623
I20260808 21:05:27.007579 15314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34623 every 8 connection(s)
I20260808 21:05:27.007951 15212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:27.009150 15315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:27.010074 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15212
I20260808 21:05:27.010223 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:27.010428 14923 external_mini_cluster.cc:1428] Setting key b65b1d3aa2848315a518c7650d75c35a
I20260808 21:05:27.012895 15315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b: Bootstrap starting.
I20260808 21:05:27.013417 15319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:27.010998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54557 (local address 127.0.0.1:34623)
0808 21:05:27.011207 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:27.011217 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:27.011258 (+ 41us) server_negotiation.cc:407] Connection header received
0808 21:05:27.011824 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:27.011835 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:27.011876 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:27.012042 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:27.012763 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:27.012768 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:27.012768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:27.012774 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:27.012824 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:27.012840 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:27.012931 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:27.013142 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 21:05:27.013188 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":88,"threads_started":1}
I20260808 21:05:27.013746 15315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:27.014127 15315 log.cc:824] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:27.014534 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:27.014921 15315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b: No bootstrap required, opened a new log
I20260808 21:05:27.017139 15319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:27.016053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35839 (local address 127.0.0.1:34623)
0808 21:05:27.016128 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:27.016130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:27.016206 (+ 76us) server_negotiation.cc:407] Connection header received
0808 21:05:27.016253 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:27.016253 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:27.016258 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:27.016333 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:27.016896 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:27.016897 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:27.016898 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:27.016904 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:27.016920 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:27.016924 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:27.017012 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:27.017039 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 21:05:27.017053 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 21:05:27.017650 15315 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99923706d2474461978f1094e164dd5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34623 } }
I20260808 21:05:27.017795 15315 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:27.017820 15315 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99923706d2474461978f1094e164dd5b, State: Initialized, Role: FOLLOWER
I20260808 21:05:27.017984 15315 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99923706d2474461978f1094e164dd5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34623 } }
I20260808 21:05:27.018072 15315 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:27.018122 15315 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:27.018179 15315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:27.018762 15315 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99923706d2474461978f1094e164dd5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34623 } }
I20260808 21:05:27.018891 15315 leader_election.cc:302] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99923706d2474461978f1094e164dd5b; no voters:
I20260808 21:05:27.019109 15315 leader_election.cc:288] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:27.019178 15333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:27.019340 15333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [term 1 LEADER]: Becoming Leader. State: Replica: 99923706d2474461978f1094e164dd5b, State: Running, Role: LEADER
I20260808 21:05:27.019373 15315 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:27.019483 15333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99923706d2474461978f1094e164dd5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34623 } }
I20260808 21:05:27.019886 15335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99923706d2474461978f1094e164dd5b. Latest consensus state: current_term: 1 leader_uuid: "99923706d2474461978f1094e164dd5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99923706d2474461978f1094e164dd5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34623 } } }
I20260808 21:05:27.019876 15334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99923706d2474461978f1094e164dd5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99923706d2474461978f1094e164dd5b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34623 } } }
I20260808 21:05:27.019999 15335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:27.020008 15334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:27.020260 15347 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:27.020814 15347 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:27.022435 15347 catalog_manager.cc:1347] Generated new cluster ID: db65e8c8832646f69a7d357126b79309
I20260808 21:05:27.022521 15347 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:27.034611 15347 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:27.034833 15347 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:27.042601 15347 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99923706d2474461978f1094e164dd5b: Generated new TSK 0
I20260808 21:05:27.042829 15347 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:27.047497 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15212
2026-08-08T21:05:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1532 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:27 dist-test-slave-t3q3 krb5kdc[15368](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:27 dist-test-slave-t3q3 krb5kdc[15368](info): set up 2 sockets
Aug 08 21:05:27 dist-test-slave-t3q3 krb5kdc[15368](info): commencing operation
krb5kdc: starting...
W20260808 21:05:28.318068 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:28 dist-test-slave-t3q3 krb5kdc[15368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:28.445153 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35089
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:28.528689 15391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:28.528893 15391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:28.528916 15391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:28.530138 15391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:28.530180 15391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:28.530195 15391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:28.530210 15391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:28.530256 15391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:28.531720 15391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:28.531965 15391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:28.532224 15391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:28.537245 15398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:28.537250 15401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:28.537271 15391 server_base.cc:1034] running on GCE node
W20260808 21:05:28.537268 15399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:28.537745 15391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:28.538009 15391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:28.539212 15391 hybrid_clock.cc:648] HybridClock initialized: now 1786223128539151 us; error 76 us; skew 500 ppm
Aug 08 21:05:28 dist-test-slave-t3q3 krb5kdc[15368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223128, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:28.541908 15391 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:28.542313 15391 webserver.cc:460] Webserver started at http://127.0.0.1:43963/ using document root <none> and password file <none>
I20260808 21:05:28.542578 15391 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:28.542626 15391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:28.542802 15391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:28.543926 15391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "d6e4789f1dbb428b803515d361d718b2"
format_stamp: "Formatted at 2026-08-08 21:05:28 on dist-test-slave-t3q3"
server_key: "f606b901d39077958cc5761b2f8f4c36"
server_key_iv: "1c35447e4732cb5c0ce1b349231825a7"
server_key_version: "encryptionkey@0"
I20260808 21:05:28.544374 15391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "d6e4789f1dbb428b803515d361d718b2"
format_stamp: "Formatted at 2026-08-08 21:05:28 on dist-test-slave-t3q3"
server_key: "f606b901d39077958cc5761b2f8f4c36"
server_key_iv: "1c35447e4732cb5c0ce1b349231825a7"
server_key_version: "encryptionkey@0"
I20260808 21:05:28.545770 15391 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:28.546558 15411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:28.546754 15391 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:28.546880 15391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "d6e4789f1dbb428b803515d361d718b2"
format_stamp: "Formatted at 2026-08-08 21:05:28 on dist-test-slave-t3q3"
server_key: "f606b901d39077958cc5761b2f8f4c36"
server_key_iv: "1c35447e4732cb5c0ce1b349231825a7"
server_key_version: "encryptionkey@0"
I20260808 21:05:28.546958 15391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:28.558555 15391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:28.560999 15391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:28.561194 15391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:28.565444 15391 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35089
I20260808 21:05:28.565478 15498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35089 every 8 connection(s)
I20260808 21:05:28.565826 15391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:28.566730 15499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:28.569141 15499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2: Bootstrap starting.
I20260808 21:05:28.569720 15499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:28.570010 15499 log.cc:824] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:28.570444 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15391
I20260808 21:05:28.570582 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:28.570789 14923 external_mini_cluster.cc:1428] Setting key dc2c932bf9ba5dbfa6ef5c3105a5661c
I20260808 21:05:28.570868 15499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2: No bootstrap required, opened a new log
I20260808 21:05:28.573169 15499 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e4789f1dbb428b803515d361d718b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } }
I20260808 21:05:28.573366 15499 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:28.573413 15499 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e4789f1dbb428b803515d361d718b2, State: Initialized, Role: FOLLOWER
I20260808 21:05:28.573552 15499 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e4789f1dbb428b803515d361d718b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } }
I20260808 21:05:28.573662 15499 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:28.573695 15499 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:28.573735 15499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:28.574421 15499 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e4789f1dbb428b803515d361d718b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } }
I20260808 21:05:28.574533 15499 leader_election.cc:302] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6e4789f1dbb428b803515d361d718b2; no voters:
I20260808 21:05:28.574679 15499 leader_election.cc:288] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:28.574836 15510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:28.574906 15499 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:28.575007 15510 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [term 1 LEADER]: Becoming Leader. State: Replica: d6e4789f1dbb428b803515d361d718b2, State: Running, Role: LEADER
I20260808 21:05:28.575139 15510 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e4789f1dbb428b803515d361d718b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } }
I20260808 21:05:28.575516 15510 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e4789f1dbb428b803515d361d718b2. Latest consensus state: current_term: 1 leader_uuid: "d6e4789f1dbb428b803515d361d718b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e4789f1dbb428b803515d361d718b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } } }
I20260808 21:05:28.575525 15511 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6e4789f1dbb428b803515d361d718b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6e4789f1dbb428b803515d361d718b2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35089 } } }
I20260808 21:05:28.575682 15510 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:28.575690 15511 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2 [sys.catalog]: This master's current role is: LEADER
W20260808 21:05:28.576794 15534 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:05:28.576861 15534 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:05:28.576946 15522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:28.577119 15522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:28.578810 15522 catalog_manager.cc:1347] Generated new cluster ID: 48261245459442968fe4215478bc7d3e
I20260808 21:05:28.578862 15522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:05:28 dist-test-slave-t3q3 krb5kdc[15368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 21:05:28.582196 15522 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:28.582891 15522 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:28.583853 15507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:28.571399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:57421 (local address 127.0.0.1:35089)
0808 21:05:28.571595 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:28.571607 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:28.571651 (+ 44us) server_negotiation.cc:407] Connection header received
0808 21:05:28.572372 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:28.572382 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:28.572449 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:28.572589 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:28.573256 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:28.574985 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:28.576261 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:28.576942 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:28.577048 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:28.579834 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:28.579838 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:28.579838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:28.579850 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:28.581887 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:28.582421 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:28.582425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:28.582425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:28.582548 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:28.582819 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:28.582820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:28.582821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:28.583138 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:28.583315 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:28.583427 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 21:05:28.583647 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260808 21:05:28.584858 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:28.586076 15522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6e4789f1dbb428b803515d361d718b2: Generated new TSK 0
I20260808 21:05:28.586228 15522 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:28.593076 15507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:28.586349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:59327 (local address 127.0.0.1:35089)
0808 21:05:28.586388 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:28.586390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:28.586639 (+ 249us) server_negotiation.cc:407] Connection header received
0808 21:05:28.586666 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:28.586667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:28.586678 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:28.586749 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:28.587221 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:28.587991 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:28.588803 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:28.589131 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:28.589205 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:28.590390 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:28.590392 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:28.590392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:28.590398 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:28.591877 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:28.592293 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:28.592294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:28.592295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:28.592356 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:28.592572 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:28.592573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:28.592573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:28.592698 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:28.592797 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:28.592901 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 21:05:28.592966 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:05:28.595227 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15391
W20260808 21:05:28.610028 15364 connection.cc:535] client connection to 127.0.0.1:35089 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35089): Connection reset by peer (error 104)
2026-08-08T21:05:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1547 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:28 dist-test-slave-t3q3 krb5kdc[15555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:28 dist-test-slave-t3q3 krb5kdc[15555](info): set up 2 sockets
Aug 08 21:05:28 dist-test-slave-t3q3 krb5kdc[15555](info): commencing operation
krb5kdc: starting...
W20260808 21:05:29.876466 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:29 dist-test-slave-t3q3 krb5kdc[15555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:30.005327 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36723
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:30.089630 15578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:30.089879 15578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:30.089920 15578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:30.091189 15578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:30.091259 15578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:30.091286 15578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:30.091320 15578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:30.091346 15578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:30.092869 15578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36723
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:30.093185 15578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:30.093418 15578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:30.098615 15586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:30.098771 15578 server_base.cc:1034] running on GCE node
W20260808 21:05:30.098632 15589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:30.098626 15585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:30.099164 15578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:30.099488 15578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:30.100668 15578 hybrid_clock.cc:648] HybridClock initialized: now 1786223130100639 us; error 46 us; skew 500 ppm
Aug 08 21:05:30 dist-test-slave-t3q3 krb5kdc[15555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223130, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:30.103186 15578 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:30.103658 15578 webserver.cc:460] Webserver started at http://127.0.0.1:38499/ using document root <none> and password file <none>
I20260808 21:05:30.103895 15578 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:30.103968 15578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:30.104267 15578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:30.105437 15578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "36af243e7f4241babadaf47dea460272"
format_stamp: "Formatted at 2026-08-08 21:05:30 on dist-test-slave-t3q3"
server_key: "bcd3997e676e0726373d8861c1c4f9e1"
server_key_iv: "208bada552a1f97ce912f069cd4cae72"
server_key_version: "encryptionkey@0"
I20260808 21:05:30.105820 15578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "36af243e7f4241babadaf47dea460272"
format_stamp: "Formatted at 2026-08-08 21:05:30 on dist-test-slave-t3q3"
server_key: "bcd3997e676e0726373d8861c1c4f9e1"
server_key_iv: "208bada552a1f97ce912f069cd4cae72"
server_key_version: "encryptionkey@0"
I20260808 21:05:30.107195 15578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:30.107920 15601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:30.108135 15578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:30.108242 15578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "36af243e7f4241babadaf47dea460272"
format_stamp: "Formatted at 2026-08-08 21:05:30 on dist-test-slave-t3q3"
server_key: "bcd3997e676e0726373d8861c1c4f9e1"
server_key_iv: "208bada552a1f97ce912f069cd4cae72"
server_key_version: "encryptionkey@0"
I20260808 21:05:30.108325 15578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:30.156580 15578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:30.158841 15578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:30.159037 15578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:30.163270 15578 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36723
I20260808 21:05:30.163327 15683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36723 every 8 connection(s)
I20260808 21:05:30.163733 15578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:30.164767 15684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:30.167115 15684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272: Bootstrap starting.
I20260808 21:05:30.167716 15684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:30.167976 15684 log.cc:824] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:30.168789 15684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272: No bootstrap required, opened a new log
I20260808 21:05:30.170410 15684 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36af243e7f4241babadaf47dea460272" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36723 } }
I20260808 21:05:30.170580 15684 raft_consensus.cc:374] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:30.170607 15684 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36af243e7f4241babadaf47dea460272, State: Initialized, Role: FOLLOWER
I20260808 21:05:30.170763 15684 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36af243e7f4241babadaf47dea460272" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36723 } }
I20260808 21:05:30.170853 15684 raft_consensus.cc:388] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:30.170879 15684 raft_consensus.cc:482] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:30.170910 15684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:30.171479 15684 raft_consensus.cc:504] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36af243e7f4241babadaf47dea460272" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36723 } }
I20260808 21:05:30.171581 15684 leader_election.cc:302] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 36af243e7f4241babadaf47dea460272; no voters:
I20260808 21:05:30.171728 15684 leader_election.cc:288] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:30.171815 15689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:30.172040 15684 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:30.172117 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15578
I20260808 21:05:30.172154 15689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [term 1 LEADER]: Becoming Leader. State: Replica: 36af243e7f4241babadaf47dea460272, State: Running, Role: LEADER
I20260808 21:05:30.172246 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:30.172395 15689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36af243e7f4241babadaf47dea460272" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36723 } }
I20260808 21:05:30.172463 14923 external_mini_cluster.cc:1428] Setting key 96f9b3544d442d0c1d17a24bebeed3cb
I20260808 21:05:30.173659 15690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "36af243e7f4241babadaf47dea460272" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36af243e7f4241babadaf47dea460272" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36723 } } }
I20260808 21:05:30.173974 15690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:30.173955 15691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 36af243e7f4241babadaf47dea460272. Latest consensus state: current_term: 1 leader_uuid: "36af243e7f4241babadaf47dea460272" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "36af243e7f4241babadaf47dea460272" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36723 } } }
I20260808 21:05:30.174263 15691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272 [sys.catalog]: This master's current role is: LEADER
W20260808 21:05:30.174566 15725 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:05:30.174633 15725 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:05:30.174726 15728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:30.174947 15728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:30.176994 15728 catalog_manager.cc:1347] Generated new cluster ID: 17a2033e03ca49039c908d58db99b35c
I20260808 21:05:30.177057 15728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:30.179152 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:30.173259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:58355 (local address 127.0.0.1:36723)
0808 21:05:30.173450 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:30.173461 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:30.173497 (+ 36us) server_negotiation.cc:407] Connection header received
0808 21:05:30.173641 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:30.173649 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:30.173766 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:30.174147 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:30.174416 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:30.175760 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:30.176949 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:30.177470 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:30.177632 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:30.178449 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:30.178454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:30.178454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:30.178666 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:30.178699 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:30.178711 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:30.178812 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:30.178899 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 21:05:30.178929 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":83,"threads_started":1}
I20260808 21:05:30.180183 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:30.184801 15708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:30.181820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:36297 (local address 127.0.0.1:36723)
0808 21:05:30.181859 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:30.181861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:30.181870 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:30.181904 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:30.181904 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:30.181915 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:30.181970 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:30.182107 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:30.182602 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:30.183363 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:30.183603 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:30.183694 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:30.184518 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:30.184519 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:30.184520 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:30.184524 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:30.184540 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:30.184544 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:30.184603 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:30.184686 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 21:05:30.184699 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:05:30.189109 15728 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:30.189842 15728 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:30.202617 15728 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 36af243e7f4241babadaf47dea460272: Generated new TSK 0
I20260808 21:05:30.202880 15728 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:30.212967 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15578
W20260808 21:05:30.228487 15553 connection.cc:535] client connection to 127.0.0.1:36723 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36723): Connection reset by peer (error 104)
2026-08-08T21:05:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1618 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:30 dist-test-slave-t3q3 krb5kdc[15742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:30 dist-test-slave-t3q3 krb5kdc[15742](info): set up 2 sockets
Aug 08 21:05:30 dist-test-slave-t3q3 krb5kdc[15742](info): commencing operation
krb5kdc: starting...
W20260808 21:05:31.479106 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:31 dist-test-slave-t3q3 krb5kdc[15742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:31.607434 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45279
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:31.692001 15758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:31.692327 15758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:31.692351 15758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:31.693583 15758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:31.693629 15758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:31.693643 15758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:31.693656 15758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:31.693670 15758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:31.695209 15758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:31.695484 15758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:31.695736 15758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:31.700922 15767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:31.700961 15771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:31.701131 15758 server_base.cc:1034] running on GCE node
W20260808 21:05:31.700943 15766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:31.701502 15758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:31.701802 15758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:31.702975 15758 hybrid_clock.cc:648] HybridClock initialized: now 1786223131702968 us; error 38 us; skew 500 ppm
Aug 08 21:05:31 dist-test-slave-t3q3 krb5kdc[15742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223131, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:31.708367 15758 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:31.708848 15758 webserver.cc:460] Webserver started at http://127.0.0.1:39425/ using document root <none> and password file <none>
I20260808 21:05:31.709136 15758 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:31.709215 15758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:31.709370 15758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:31.710477 15758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "127863e19c2a4800adef98f51063e0b3"
format_stamp: "Formatted at 2026-08-08 21:05:31 on dist-test-slave-t3q3"
server_key: "93882dc8984fe3aa6a6f41d1fe38fc18"
server_key_iv: "3deab1b7c3ce72562d49b6e6c391b565"
server_key_version: "encryptionkey@0"
I20260808 21:05:31.710850 15758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "127863e19c2a4800adef98f51063e0b3"
format_stamp: "Formatted at 2026-08-08 21:05:31 on dist-test-slave-t3q3"
server_key: "93882dc8984fe3aa6a6f41d1fe38fc18"
server_key_iv: "3deab1b7c3ce72562d49b6e6c391b565"
server_key_version: "encryptionkey@0"
I20260808 21:05:31.712306 15758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:31.713069 15786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:31.713238 15758 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:31.713348 15758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "127863e19c2a4800adef98f51063e0b3"
format_stamp: "Formatted at 2026-08-08 21:05:31 on dist-test-slave-t3q3"
server_key: "93882dc8984fe3aa6a6f41d1fe38fc18"
server_key_iv: "3deab1b7c3ce72562d49b6e6c391b565"
server_key_version: "encryptionkey@0"
I20260808 21:05:31.713424 15758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:31.716945 15758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:31.719367 15758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:31.719538 15758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:31.723795 15758 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45279
I20260808 21:05:31.723831 15882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45279 every 8 connection(s)
I20260808 21:05:31.724293 15758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:31.725378 15883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:31.727775 15883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3: Bootstrap starting.
I20260808 21:05:31.728526 15883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:31.728828 15883 log.cc:824] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:31.729571 15883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3: No bootstrap required, opened a new log
I20260808 21:05:31.731184 15883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127863e19c2a4800adef98f51063e0b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } }
I20260808 21:05:31.731346 15883 raft_consensus.cc:374] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:31.731371 15883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 127863e19c2a4800adef98f51063e0b3, State: Initialized, Role: FOLLOWER
I20260808 21:05:31.731586 15883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127863e19c2a4800adef98f51063e0b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } }
I20260808 21:05:31.731659 15883 raft_consensus.cc:388] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:31.731683 15883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:31.731751 15883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:31.732435 15883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127863e19c2a4800adef98f51063e0b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } }
I20260808 21:05:31.732559 15883 leader_election.cc:302] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 127863e19c2a4800adef98f51063e0b3; no voters:
I20260808 21:05:31.732753 15883 leader_election.cc:288] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:31.732810 15890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:31.733055 15883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:31.733126 15890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [term 1 LEADER]: Becoming Leader. State: Replica: 127863e19c2a4800adef98f51063e0b3, State: Running, Role: LEADER
I20260808 21:05:31.733242 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15758
I20260808 21:05:31.733284 15890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127863e19c2a4800adef98f51063e0b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } }
I20260808 21:05:31.733368 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:31.733565 14923 external_mini_cluster.cc:1428] Setting key b9a207e2b265c98040456bfbd412d632
I20260808 21:05:31.733911 15892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 127863e19c2a4800adef98f51063e0b3. Latest consensus state: current_term: 1 leader_uuid: "127863e19c2a4800adef98f51063e0b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127863e19c2a4800adef98f51063e0b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } } }
I20260808 21:05:31.734004 15892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:31.734571 15891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "127863e19c2a4800adef98f51063e0b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "127863e19c2a4800adef98f51063e0b3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } } }
I20260808 21:05:31.734652 15891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:31.734891 15894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:31.735518 15894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:31.736086 15911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:31.734231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:37801 (local address 127.0.0.1:45279)
0808 21:05:31.734460 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:31.734469 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:31.734516 (+ 47us) server_negotiation.cc:407] Connection header received
0808 21:05:31.734616 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:31.734622 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:31.734645 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:31.734806 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:31.735586 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:31.735590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:31.735591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:31.735595 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:31.735644 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:31.735659 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:31.735699 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:31.735830 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 21:05:31.735875 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":105,"threads_started":1}
I20260808 21:05:31.737430 15894 catalog_manager.cc:1347] Generated new cluster ID: 6f58e60f8c944de997a3c5a2dbfe9353
I20260808 21:05:31.737442 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:31.737483 15894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:31.741205 15911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:31.739086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:53157 (local address 127.0.0.1:45279)
0808 21:05:31.739151 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:31.739153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:31.740231 (+ 1078us) server_negotiation.cc:407] Connection header received
0808 21:05:31.740283 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:31.740284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:31.740289 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:31.740362 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:31.740979 (+ 617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:31.740980 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:31.740980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:31.740984 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:31.741002 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:31.741007 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:31.741077 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:31.741130 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 21:05:31.741143 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 21:05:31.759542 15894 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:31.759775 15894 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:31.767647 15894 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 127863e19c2a4800adef98f51063e0b3: Generated new TSK 0
I20260808 21:05:31.767884 15894 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:31.775120 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15758
2026-08-08T21:05:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1559 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:31 dist-test-slave-t3q3 krb5kdc[15940](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:31 dist-test-slave-t3q3 krb5kdc[15940](info): set up 2 sockets
Aug 08 21:05:31 dist-test-slave-t3q3 krb5kdc[15940](info): commencing operation
krb5kdc: starting...
W20260808 21:05:33.037132 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:33 dist-test-slave-t3q3 krb5kdc[15940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:33.162770 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44943
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:33.246802 15963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:33.247012 15963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:33.247036 15963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:33.248262 15963 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:33.248306 15963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:33.248320 15963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:33.248333 15963 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:33.248345 15963 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:33.249841 15963 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44943
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:33.250104 15963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:33.250355 15963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:33.255722 15968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:33.255704 15974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:33.255728 15971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:33.255795 15963 server_base.cc:1034] running on GCE node
I20260808 21:05:33.256263 15963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:33.256596 15963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:33.257781 15963 hybrid_clock.cc:648] HybridClock initialized: now 1786223133257765 us; error 44 us; skew 500 ppm
Aug 08 21:05:33 dist-test-slave-t3q3 krb5kdc[15940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223133, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:33.260380 15963 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:33.260881 15963 webserver.cc:460] Webserver started at http://127.0.0.1:45643/ using document root <none> and password file <none>
I20260808 21:05:33.261143 15963 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:33.261214 15963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:33.261369 15963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:33.262535 15963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "23a60d32747742d2bca6edbcbbf0d0a7"
format_stamp: "Formatted at 2026-08-08 21:05:33 on dist-test-slave-t3q3"
server_key: "aaa8cb57fd308271b3e4526aa424bb18"
server_key_iv: "468174e7ef758e81a15367b63c79fb6f"
server_key_version: "encryptionkey@0"
I20260808 21:05:33.262919 15963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "23a60d32747742d2bca6edbcbbf0d0a7"
format_stamp: "Formatted at 2026-08-08 21:05:33 on dist-test-slave-t3q3"
server_key: "aaa8cb57fd308271b3e4526aa424bb18"
server_key_iv: "468174e7ef758e81a15367b63c79fb6f"
server_key_version: "encryptionkey@0"
I20260808 21:05:33.264381 15963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 21:05:33.265165 15989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:33.265349 15963 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:33.265462 15963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "23a60d32747742d2bca6edbcbbf0d0a7"
format_stamp: "Formatted at 2026-08-08 21:05:33 on dist-test-slave-t3q3"
server_key: "aaa8cb57fd308271b3e4526aa424bb18"
server_key_iv: "468174e7ef758e81a15367b63c79fb6f"
server_key_version: "encryptionkey@0"
I20260808 21:05:33.265539 15963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:33.277765 15963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:33.279685 15963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:33.279857 15963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:33.284163 15963 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44943
I20260808 21:05:33.284195 16075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44943 every 8 connection(s)
I20260808 21:05:33.284550 15963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:33.285465 16076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:33.287834 16076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7: Bootstrap starting.
I20260808 21:05:33.287953 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 15963
I20260808 21:05:33.288100 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:33.288307 14923 external_mini_cluster.cc:1428] Setting key 8082e17dd71aa85b99ce78408e0e9132
I20260808 21:05:33.288662 16076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:33.289012 16076 log.cc:824] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:33.289786 16076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7: No bootstrap required, opened a new log
I20260808 21:05:33.292215 16076 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a60d32747742d2bca6edbcbbf0d0a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260808 21:05:33.292392 16076 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:33.292424 16076 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23a60d32747742d2bca6edbcbbf0d0a7, State: Initialized, Role: FOLLOWER
I20260808 21:05:33.292546 16076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a60d32747742d2bca6edbcbbf0d0a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260808 21:05:33.292623 16076 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:33.292654 16076 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:33.292701 16076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:33.293345 16076 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a60d32747742d2bca6edbcbbf0d0a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260808 21:05:33.293467 16076 leader_election.cc:302] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23a60d32747742d2bca6edbcbbf0d0a7; no voters:
I20260808 21:05:33.293646 16076 leader_election.cc:288] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:33.293684 16083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:33.293843 16083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [term 1 LEADER]: Becoming Leader. State: Replica: 23a60d32747742d2bca6edbcbbf0d0a7, State: Running, Role: LEADER
I20260808 21:05:33.293962 16076 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:33.294029 16083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a60d32747742d2bca6edbcbbf0d0a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } }
I20260808 21:05:33.294397 16085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23a60d32747742d2bca6edbcbbf0d0a7. Latest consensus state: current_term: 1 leader_uuid: "23a60d32747742d2bca6edbcbbf0d0a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a60d32747742d2bca6edbcbbf0d0a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } } }
I20260808 21:05:33.294502 16085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:33.294752 16093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:33.295296 16093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 21:05:33 dist-test-slave-t3q3 krb5kdc[15940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 21:05:33.295871 16084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23a60d32747742d2bca6edbcbbf0d0a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23a60d32747742d2bca6edbcbbf0d0a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44943 } } }
I20260808 21:05:33.295971 16084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:33.297549 16093 catalog_manager.cc:1347] Generated new cluster ID: 2b39620982e94b0980c173d5780643fe
I20260808 21:05:33.297603 16093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:33.300637 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:33.288816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:58387 (local address 127.0.0.1:44943)
0808 21:05:33.289035 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:33.289045 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:33.289079 (+ 34us) server_negotiation.cc:407] Connection header received
0808 21:05:33.289694 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:33.289702 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:33.289759 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:33.289928 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:33.290752 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:33.291650 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:33.292797 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:33.293240 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:33.293325 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:33.296591 (+ 3266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:33.296595 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:33.296595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:33.296606 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:33.298720 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:33.299223 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:33.299228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:33.299228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:33.299348 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:33.299607 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:33.299608 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:33.299609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:33.299945 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:33.300165 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:33.300283 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 21:05:33.300392 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":88,"threads_started":1}
I20260808 21:05:33.301681 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:33.310734 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:33.303100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:38859 (local address 127.0.0.1:44943)
0808 21:05:33.303138 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:33.303140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:33.303288 (+ 148us) server_negotiation.cc:407] Connection header received
0808 21:05:33.303317 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:33.303318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:33.303330 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:33.303401 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:33.304023 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:33.304838 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:33.305845 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:33.306195 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:33.306273 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:33.307702 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:33.307703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:33.307703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:33.307711 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:33.309360 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:33.309791 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:33.309793 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:33.309793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:33.309856 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:33.310085 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:33.310086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:33.310086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:33.310223 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:33.310330 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:33.310447 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 21:05:33.310515 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:05:33.314762 16093 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:33.315270 16093 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:33.318524 16093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23a60d32747742d2bca6edbcbbf0d0a7: Generated new TSK 0
I20260808 21:05:33.318740 16093 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:33.321098 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 15963
W20260808 21:05:33.336560 15935 connection.cc:535] client connection to 127.0.0.1:44943 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44943): Connection reset by peer (error 104)
2026-08-08T21:05:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1548 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:33 dist-test-slave-t3q3 krb5kdc[16125](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:33 dist-test-slave-t3q3 krb5kdc[16125](info): set up 2 sockets
Aug 08 21:05:33 dist-test-slave-t3q3 krb5kdc[16125](info): commencing operation
krb5kdc: starting...
W20260808 21:05:34.586691 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:34 dist-test-slave-t3q3 krb5kdc[16125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:34.711217 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40169
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:34.798586 16145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:34.798815 16145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:34.798840 16145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:34.799932 16145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:34.799968 16145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:34.799983 16145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:34.799995 16145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:34.800007 16145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:34.801653 16145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40169
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:34.801872 16145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:34.802047 16145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:34.807286 16159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:34.807324 16152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:34.807492 16145 server_base.cc:1034] running on GCE node
W20260808 21:05:34.807489 16151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:34.807917 16145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:34.808275 16145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:34.809453 16145 hybrid_clock.cc:648] HybridClock initialized: now 1786223134809434 us; error 37 us; skew 500 ppm
Aug 08 21:05:34 dist-test-slave-t3q3 krb5kdc[16125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223134, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:34.812127 16145 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:34.812623 16145 webserver.cc:460] Webserver started at http://127.0.0.1:46463/ using document root <none> and password file <none>
I20260808 21:05:34.812870 16145 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:34.812939 16145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:34.813107 16145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:34.814201 16145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "55aa51e5435a4842a806e882dd90944f"
format_stamp: "Formatted at 2026-08-08 21:05:34 on dist-test-slave-t3q3"
server_key: "30b8a3d1dcf00d1010798ee2c67def56"
server_key_iv: "41620109c750d6d31d3673cddfbbb04f"
server_key_version: "encryptionkey@0"
I20260808 21:05:34.814582 16145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "55aa51e5435a4842a806e882dd90944f"
format_stamp: "Formatted at 2026-08-08 21:05:34 on dist-test-slave-t3q3"
server_key: "30b8a3d1dcf00d1010798ee2c67def56"
server_key_iv: "41620109c750d6d31d3673cddfbbb04f"
server_key_version: "encryptionkey@0"
I20260808 21:05:34.815932 16145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:34.816735 16172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:34.816939 16145 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:34.817044 16145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "55aa51e5435a4842a806e882dd90944f"
format_stamp: "Formatted at 2026-08-08 21:05:34 on dist-test-slave-t3q3"
server_key: "30b8a3d1dcf00d1010798ee2c67def56"
server_key_iv: "41620109c750d6d31d3673cddfbbb04f"
server_key_version: "encryptionkey@0"
I20260808 21:05:34.817127 16145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:34.831476 16145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:34.834038 16145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:34.834213 16145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:34.838855 16145 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40169
I20260808 21:05:34.838896 16253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40169 every 8 connection(s)
I20260808 21:05:34.839280 16145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:34.840235 16255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:34.842612 16255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f: Bootstrap starting.
I20260808 21:05:34.843150 16255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:34.843387 16255 log.cc:824] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:34.844144 16255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f: No bootstrap required, opened a new log
I20260808 21:05:34.845703 16255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55aa51e5435a4842a806e882dd90944f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40169 } }
I20260808 21:05:34.845844 16255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:34.845867 16255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55aa51e5435a4842a806e882dd90944f, State: Initialized, Role: FOLLOWER
I20260808 21:05:34.845973 16255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55aa51e5435a4842a806e882dd90944f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40169 } }
I20260808 21:05:34.846028 16255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:34.846050 16255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:34.846134 16255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:34.846746 16255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55aa51e5435a4842a806e882dd90944f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40169 } }
I20260808 21:05:34.846861 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16145
I20260808 21:05:34.846872 16255 leader_election.cc:302] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55aa51e5435a4842a806e882dd90944f; no voters:
I20260808 21:05:34.846990 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:34.847045 16255 leader_election.cc:288] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:34.847127 16258 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:34.847236 14923 external_mini_cluster.cc:1428] Setting key 1a9289fbf6da273a3a53a4c8ec57c57c
I20260808 21:05:34.847307 16258 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [term 1 LEADER]: Becoming Leader. State: Replica: 55aa51e5435a4842a806e882dd90944f, State: Running, Role: LEADER
I20260808 21:05:34.847368 16255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:34.847417 16258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55aa51e5435a4842a806e882dd90944f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40169 } }
I20260808 21:05:34.847704 16258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55aa51e5435a4842a806e882dd90944f. Latest consensus state: current_term: 1 leader_uuid: "55aa51e5435a4842a806e882dd90944f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55aa51e5435a4842a806e882dd90944f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40169 } } }
I20260808 21:05:34.847793 16258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:34.847954 16260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55aa51e5435a4842a806e882dd90944f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55aa51e5435a4842a806e882dd90944f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40169 } } }
I20260808 21:05:34.848112 16274 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:34.848635 16274 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:34.849061 16260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:34.850997 16274 catalog_manager.cc:1347] Generated new cluster ID: 21ce3a8dfb504a479c341eab2aa56dd5
I20260808 21:05:34.851087 16274 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:34.854333 16279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:34.848046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:37815 (local address 127.0.0.1:40169)
0808 21:05:34.848635 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:34.848646 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:34.848686 (+ 40us) server_negotiation.cc:407] Connection header received
0808 21:05:34.848818 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:34.848827 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:34.848895 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:34.849448 (+ 553us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:34.849545 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:34.850885 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:34.852111 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:34.852705 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:34.852802 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:34.853606 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:34.853610 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:34.853610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:34.853809 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:34.853844 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:34.853858 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:34.853933 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:34.854081 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 21:05:34.854109 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":80,"threads_started":1}
I20260808 21:05:34.855278 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:34.860711 16279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:34.856875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:47687 (local address 127.0.0.1:40169)
0808 21:05:34.856907 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:34.856908 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:34.857042 (+ 134us) server_negotiation.cc:407] Connection header received
0808 21:05:34.857098 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:34.857099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:34.857108 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:34.857161 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:34.857297 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:34.858315 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:34.859347 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:34.859666 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:34.859727 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:34.860477 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:34.860478 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:34.860478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:34.860482 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:34.860494 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:34.860498 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:34.860552 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:34.860629 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 21:05:34.860640 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 21:05:34.882335 16274 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:34.882891 16274 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:34.888015 16274 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55aa51e5435a4842a806e882dd90944f: Generated new TSK 0
I20260808 21:05:34.888226 16274 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:34.893694 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16145
W20260808 21:05:34.905579 16123 connection.cc:535] client connection to 127.0.0.1:40169 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40169): Connection reset by peer (error 104)
2026-08-08T21:05:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1568 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:34 dist-test-slave-t3q3 krb5kdc[16300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:34 dist-test-slave-t3q3 krb5kdc[16300](info): set up 2 sockets
Aug 08 21:05:34 dist-test-slave-t3q3 krb5kdc[16300](info): commencing operation
krb5kdc: starting...
W20260808 21:05:36.142114 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:36 dist-test-slave-t3q3 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 21:05:36.271459 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:36.358639 16321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:36.358881 16321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:36.358922 16321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:36.360138 16321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:36.360198 16321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:36.360224 16321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:36.360255 16321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:36.360281 16321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:36.361797 16321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33469
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:36.362088 16321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:36.362329 16321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:36.367259 16328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:36.367282 16331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:36.367266 16327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:36.367609 16321 server_base.cc:1034] running on GCE node
I20260808 21:05:36.367897 16321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:36.368271 16321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:36.369443 16321 hybrid_clock.cc:648] HybridClock initialized: now 1786223136369421 us; error 32 us; skew 500 ppm
Aug 08 21:05:36 dist-test-slave-t3q3 krb5kdc[16300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223136, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:36.371927 16321 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 21:05:36.372422 16321 webserver.cc:460] Webserver started at http://127.0.0.1:40327/ using document root <none> and password file <none>
I20260808 21:05:36.372679 16321 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:36.372784 16321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:36.372936 16321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:36.374013 16321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "8edf0698eedb4fa5a3769bd5639172b1"
format_stamp: "Formatted at 2026-08-08 21:05:36 on dist-test-slave-t3q3"
server_key: "9aefa5a179a7364c5473148930712e61"
server_key_iv: "94e6d358cd338c6d0d077c04a34aa4a0"
server_key_version: "encryptionkey@0"
I20260808 21:05:36.374390 16321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "8edf0698eedb4fa5a3769bd5639172b1"
format_stamp: "Formatted at 2026-08-08 21:05:36 on dist-test-slave-t3q3"
server_key: "9aefa5a179a7364c5473148930712e61"
server_key_iv: "94e6d358cd338c6d0d077c04a34aa4a0"
server_key_version: "encryptionkey@0"
I20260808 21:05:36.375757 16321 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:36.376675 16351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:36.376857 16321 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 21:05:36.376978 16321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "8edf0698eedb4fa5a3769bd5639172b1"
format_stamp: "Formatted at 2026-08-08 21:05:36 on dist-test-slave-t3q3"
server_key: "9aefa5a179a7364c5473148930712e61"
server_key_iv: "94e6d358cd338c6d0d077c04a34aa4a0"
server_key_version: "encryptionkey@0"
I20260808 21:05:36.377053 16321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:36.380352 16321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:36.382253 16321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:36.382407 16321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:36.386572 16321 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33469
I20260808 21:05:36.386611 16434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33469 every 8 connection(s)
I20260808 21:05:36.386986 16321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:36.387200 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16321
I20260808 21:05:36.387326 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:36.387495 14923 external_mini_cluster.cc:1428] Setting key b0c58f8b538d1c667e593ea31a5b044b
I20260808 21:05:36.388348 16435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:36.390267 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:36.388003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:37577 (local address 127.0.0.1:33469)
0808 21:05:36.388251 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:36.388260 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:36.388294 (+ 34us) server_negotiation.cc:407] Connection header received
0808 21:05:36.388883 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:36.388892 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:36.388925 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:36.389072 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:36.389735 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:36.389738 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:36.389739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:36.389743 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:36.389788 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:36.389803 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:36.389887 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:36.389923 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 21:05:36.390071 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":112,"threads_started":1}
I20260808 21:05:36.391319 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:36.391465 16435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1: Bootstrap starting.
I20260808 21:05:36.392107 16435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:36.392481 16435 log.cc:824] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:36.393375 16435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1: No bootstrap required, opened a new log
I20260808 21:05:36.393937 16439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:36.392841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.50:60663 (local address 127.0.0.1:33469)
0808 21:05:36.392883 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:36.392885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:36.392985 (+ 100us) server_negotiation.cc:407] Connection header received
0808 21:05:36.393067 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:36.393068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:36.393071 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:36.393110 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:36.393713 (+ 603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:36.393714 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:36.393714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:36.393718 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:36.393730 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:36.393734 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:36.393779 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:36.393839 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 21:05:36.393850 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:05:36.395633 16435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8edf0698eedb4fa5a3769bd5639172b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } }
I20260808 21:05:36.395808 16435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:36.395859 16435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8edf0698eedb4fa5a3769bd5639172b1, State: Initialized, Role: FOLLOWER
I20260808 21:05:36.395982 16435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8edf0698eedb4fa5a3769bd5639172b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } }
I20260808 21:05:36.396121 16435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:36.396163 16435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:36.396224 16435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:36.396852 16435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8edf0698eedb4fa5a3769bd5639172b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } }
I20260808 21:05:36.397027 16435 leader_election.cc:302] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8edf0698eedb4fa5a3769bd5639172b1; no voters:
I20260808 21:05:36.397226 16435 leader_election.cc:288] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:36.397261 16446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:36.397493 16435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:36.397491 16446 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [term 1 LEADER]: Becoming Leader. State: Replica: 8edf0698eedb4fa5a3769bd5639172b1, State: Running, Role: LEADER
I20260808 21:05:36.397696 16446 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8edf0698eedb4fa5a3769bd5639172b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } }
I20260808 21:05:36.398118 16448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8edf0698eedb4fa5a3769bd5639172b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8edf0698eedb4fa5a3769bd5639172b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } } }
I20260808 21:05:36.398212 16448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:36.398360 16448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8edf0698eedb4fa5a3769bd5639172b1. Latest consensus state: current_term: 1 leader_uuid: "8edf0698eedb4fa5a3769bd5639172b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8edf0698eedb4fa5a3769bd5639172b1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } } }
I20260808 21:05:36.398409 16448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:36.398831 16464 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:36.399361 16464 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:36.400916 16464 catalog_manager.cc:1347] Generated new cluster ID: 1df384a0af6d4333b451846c7c0a29e7
I20260808 21:05:36.400969 16464 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:36.412029 16464 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:36.412226 16464 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:36.419061 16464 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8edf0698eedb4fa5a3769bd5639172b1: Generated new TSK 0
I20260808 21:05:36.419278 16464 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:36.421270 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16321
2026-08-08T21:05:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1527 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:36 dist-test-slave-t3q3 krb5kdc[16481](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:36 dist-test-slave-t3q3 krb5kdc[16481](info): set up 2 sockets
Aug 08 21:05:36 dist-test-slave-t3q3 krb5kdc[16481](info): commencing operation
krb5kdc: starting...
W20260808 21:05:37.678603 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:37 dist-test-slave-t3q3 krb5kdc[16481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:37.802676 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:35083
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:35083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:37.890089 16502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:37.890309 16502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:37.890334 16502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:37.891412 16502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:37.891449 16502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:37.891463 16502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:37.891481 16502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:37.891496 16502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:37.893060 16502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:35083
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:35083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:37.893352 16502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:37.893579 16502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:37.898990 16512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:37.899093 16517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:37.899149 16502 server_base.cc:1034] running on GCE node
W20260808 21:05:37.899269 16513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:37.899544 16502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:37.899838 16502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:37.901002 16502 hybrid_clock.cc:648] HybridClock initialized: now 1786223137900976 us; error 60 us; skew 500 ppm
Aug 08 21:05:37 dist-test-slave-t3q3 krb5kdc[16481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223137, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:37.907454 16502 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:37.907935 16502 webserver.cc:460] Webserver started at http://127.14.146.254:36941/ using document root <none> and password file <none>
I20260808 21:05:37.908192 16502 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:37.908243 16502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:37.908344 16502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:37.909373 16502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "8891ed6bf2a946ee9003a6269c6fb266"
format_stamp: "Formatted at 2026-08-08 21:05:37 on dist-test-slave-t3q3"
server_key: "d3c3b0b90a5bd6be57ba5b83e613fec6"
server_key_iv: "e1ddf2ed414eb8e34b4c29489ab252a0"
server_key_version: "encryptionkey@0"
I20260808 21:05:37.909682 16502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "8891ed6bf2a946ee9003a6269c6fb266"
format_stamp: "Formatted at 2026-08-08 21:05:37 on dist-test-slave-t3q3"
server_key: "d3c3b0b90a5bd6be57ba5b83e613fec6"
server_key_iv: "e1ddf2ed414eb8e34b4c29489ab252a0"
server_key_version: "encryptionkey@0"
I20260808 21:05:37.911273 16502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:37.912024 16527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:37.912266 16502 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:05:37.912359 16502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "8891ed6bf2a946ee9003a6269c6fb266"
format_stamp: "Formatted at 2026-08-08 21:05:37 on dist-test-slave-t3q3"
server_key: "d3c3b0b90a5bd6be57ba5b83e613fec6"
server_key_iv: "e1ddf2ed414eb8e34b4c29489ab252a0"
server_key_version: "encryptionkey@0"
I20260808 21:05:37.912420 16502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:37.922365 16502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:37.924647 16502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:37.924768 16502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:37.928833 16502 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:35083
I20260808 21:05:37.928891 16607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:35083 every 8 connection(s)
I20260808 21:05:37.929220 16502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:37.930128 16608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:37.932566 16608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266: Bootstrap starting.
I20260808 21:05:37.933190 16608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:37.933503 16608 log.cc:824] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:37.934231 16608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266: No bootstrap required, opened a new log
I20260808 21:05:37.935850 16608 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8891ed6bf2a946ee9003a6269c6fb266" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35083 } }
I20260808 21:05:37.936022 16608 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:37.936065 16608 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8891ed6bf2a946ee9003a6269c6fb266, State: Initialized, Role: FOLLOWER
I20260808 21:05:37.936275 16608 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8891ed6bf2a946ee9003a6269c6fb266" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35083 } }
I20260808 21:05:37.936372 16608 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:37.936419 16608 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:37.936474 16608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:37.937368 16608 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8891ed6bf2a946ee9003a6269c6fb266" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35083 } }
I20260808 21:05:37.937501 16608 leader_election.cc:302] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8891ed6bf2a946ee9003a6269c6fb266; no voters:
I20260808 21:05:37.937698 16608 leader_election.cc:288] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:37.937727 16613 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:37.937879 16613 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [term 1 LEADER]: Becoming Leader. State: Replica: 8891ed6bf2a946ee9003a6269c6fb266, State: Running, Role: LEADER
I20260808 21:05:37.937990 16608 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:37.938045 16613 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8891ed6bf2a946ee9003a6269c6fb266" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35083 } }
I20260808 21:05:37.938419 16615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8891ed6bf2a946ee9003a6269c6fb266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8891ed6bf2a946ee9003a6269c6fb266" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35083 } } }
I20260808 21:05:37.938678 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16502
I20260808 21:05:37.938812 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:37.939011 14923 external_mini_cluster.cc:1428] Setting key f9e99a932071fc947d9071a9cc39d4ec
I20260808 21:05:37.938565 16615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:37.938421 16619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8891ed6bf2a946ee9003a6269c6fb266. Latest consensus state: current_term: 1 leader_uuid: "8891ed6bf2a946ee9003a6269c6fb266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8891ed6bf2a946ee9003a6269c6fb266" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 35083 } } }
I20260808 21:05:37.939487 16619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:37.939522 16634 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:37.940593 16634 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:37.943013 16634 catalog_manager.cc:1347] Generated new cluster ID: 63bf01e2888a4a139ff096b31e092b94
I20260808 21:05:37.943073 16634 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 21:05:37 dist-test-slave-t3q3 krb5kdc[16481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:37.950150 16644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:37.939707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50279 (local address 127.14.146.254:35083)
0808 21:05:37.939902 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:37.939913 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:37.939960 (+ 47us) server_negotiation.cc:407] Connection header received
0808 21:05:37.940118 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:37.940125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:37.940185 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:37.940300 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:37.941153 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:37.942546 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:37.943456 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:37.943900 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:37.944048 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:37.946508 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:37.946512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:37.946513 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:37.946527 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:37.948527 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:37.948933 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:37.948936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:37.948937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:37.949041 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:37.949284 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:37.949285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:37.949286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:37.949530 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:37.949715 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:37.949836 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 21:05:37.949945 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
I20260808 21:05:37.951187 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:37.958146 16634 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:37.958853 16634 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:37.963225 16644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:37.956461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46297 (local address 127.14.146.254:35083)
0808 21:05:37.956504 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:37.956506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:37.956650 (+ 144us) server_negotiation.cc:407] Connection header received
0808 21:05:37.956739 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:37.956740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:37.956750 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:37.956816 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:37.957362 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:37.957992 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:37.958818 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:37.959110 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:37.959202 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:37.960532 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:37.960534 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:37.960534 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:37.960541 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:37.961994 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:37.962375 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:37.962376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:37.962376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:37.962438 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:37.962665 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:37.962667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:37.962667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:37.962781 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:37.962911 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:37.963033 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 21:05:37.963101 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":21}
I20260808 21:05:37.964084 16634 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8891ed6bf2a946ee9003a6269c6fb266: Generated new TSK 0
I20260808 21:05:37.964270 16634 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:37.969434 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16502
W20260808 21:05:37.983620 16479 connection.cc:535] client connection to 127.14.146.254:35083 recv error: Network error: failed to read from TLS socket (remote: 127.14.146.254:35083): Connection reset by peer (error 104)
2026-08-08T21:05:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1550 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:38 dist-test-slave-t3q3 krb5kdc[16658](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:38 dist-test-slave-t3q3 krb5kdc[16658](info): set up 2 sockets
Aug 08 21:05:38 dist-test-slave-t3q3 krb5kdc[16658](info): commencing operation
krb5kdc: starting...
W20260808 21:05:39.239079 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:39 dist-test-slave-t3q3 krb5kdc[16658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:39.366890 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39947
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:39947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:39.451361 16679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:39.451587 16679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:39.451627 16679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:39.452822 16679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:39.452891 16679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:39.452917 16679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:39.452946 16679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:39.452976 16679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:39.454470 16679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:39947
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:39947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:39.454749 16679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:39.454983 16679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:39.459887 16685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:39.459878 16684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:39.459880 16688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:39.460413 16679 server_base.cc:1034] running on GCE node
I20260808 21:05:39.460659 16679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:39.460945 16679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:39.462098 16679 hybrid_clock.cc:648] HybridClock initialized: now 1786223139462073 us; error 42 us; skew 500 ppm
Aug 08 21:05:39 dist-test-slave-t3q3 krb5kdc[16658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223139, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:39.464684 16679 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:39.465149 16679 webserver.cc:460] Webserver started at http://127.14.146.254:45253/ using document root <none> and password file <none>
I20260808 21:05:39.465389 16679 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:39.465461 16679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:39.465616 16679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:39.466683 16679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "a5b6e1edcfc1492393f403177a786de1"
format_stamp: "Formatted at 2026-08-08 21:05:39 on dist-test-slave-t3q3"
server_key: "d1d01f9be8ee9d199a403c73621c89e8"
server_key_iv: "a3c753974cc96ec514de6ce7d44e3d6f"
server_key_version: "encryptionkey@0"
I20260808 21:05:39.467062 16679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "a5b6e1edcfc1492393f403177a786de1"
format_stamp: "Formatted at 2026-08-08 21:05:39 on dist-test-slave-t3q3"
server_key: "d1d01f9be8ee9d199a403c73621c89e8"
server_key_iv: "a3c753974cc96ec514de6ce7d44e3d6f"
server_key_version: "encryptionkey@0"
I20260808 21:05:39.468498 16679 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:39.469244 16698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:39.469431 16679 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:39.469539 16679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "a5b6e1edcfc1492393f403177a786de1"
format_stamp: "Formatted at 2026-08-08 21:05:39 on dist-test-slave-t3q3"
server_key: "d1d01f9be8ee9d199a403c73621c89e8"
server_key_iv: "a3c753974cc96ec514de6ce7d44e3d6f"
server_key_version: "encryptionkey@0"
I20260808 21:05:39.469616 16679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:39.487640 16679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:39.489624 16679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:39.489809 16679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:39.494164 16679 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:39947
I20260808 21:05:39.494201 16771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:39947 every 8 connection(s)
I20260808 21:05:39.494557 16679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:39.495450 16773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:39.497896 16773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1: Bootstrap starting.
I20260808 21:05:39.498451 16773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:39.498692 16773 log.cc:824] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:39.499432 16773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1: No bootstrap required, opened a new log
I20260808 21:05:39.501083 16773 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b6e1edcfc1492393f403177a786de1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39947 } }
I20260808 21:05:39.501227 16773 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:39.501260 16773 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5b6e1edcfc1492393f403177a786de1, State: Initialized, Role: FOLLOWER
I20260808 21:05:39.501363 16773 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b6e1edcfc1492393f403177a786de1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39947 } }
I20260808 21:05:39.501417 16773 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:39.501437 16773 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:39.501463 16773 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:39.502298 16773 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b6e1edcfc1492393f403177a786de1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39947 } }
I20260808 21:05:39.502429 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16679
I20260808 21:05:39.502429 16773 leader_election.cc:302] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5b6e1edcfc1492393f403177a786de1; no voters:
I20260808 21:05:39.502558 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:39.502607 16773 leader_election.cc:288] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:39.502672 16779 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:39.502805 14923 external_mini_cluster.cc:1428] Setting key fbfa35b1c2c4b733b06a16594836a3c2
I20260808 21:05:39.502836 16779 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [term 1 LEADER]: Becoming Leader. State: Replica: a5b6e1edcfc1492393f403177a786de1, State: Running, Role: LEADER
I20260808 21:05:39.502938 16773 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:39.502925 16779 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b6e1edcfc1492393f403177a786de1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39947 } }
I20260808 21:05:39.503497 16781 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5b6e1edcfc1492393f403177a786de1. Latest consensus state: current_term: 1 leader_uuid: "a5b6e1edcfc1492393f403177a786de1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b6e1edcfc1492393f403177a786de1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39947 } } }
I20260808 21:05:39.503616 16781 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:39.503487 16780 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5b6e1edcfc1492393f403177a786de1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b6e1edcfc1492393f403177a786de1" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 39947 } } }
I20260808 21:05:39.503942 16780 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:39.504048 16796 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:39.504694 16796 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:39.506393 16796 catalog_manager.cc:1347] Generated new cluster ID: 680d58779f0e42bdbd471ee4cfcb3c51
I20260808 21:05:39.506449 16796 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:39.509048 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:39.503345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49823 (local address 127.14.146.254:39947)
0808 21:05:39.503885 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:39.503894 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:39.503927 (+ 33us) server_negotiation.cc:407] Connection header received
0808 21:05:39.504082 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:39.504091 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:39.504161 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:39.504316 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:39.504739 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:39.506133 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:39.507046 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:39.507482 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:39.507606 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:39.508405 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:39.508409 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:39.508409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:39.508601 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:39.508636 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:39.508647 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:39.508756 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:39.508840 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 21:05:39.508870 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":66,"threads_started":1}
I20260808 21:05:39.509996 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:39.519188 16796 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:39.519275 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:39.511394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47487 (local address 127.14.146.254:39947)
0808 21:05:39.511457 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:39.511459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:39.516229 (+ 4770us) server_negotiation.cc:407] Connection header received
0808 21:05:39.516309 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:39.516310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:39.516323 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:39.516406 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:39.516553 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:39.517061 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:39.517866 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:39.518089 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:39.518172 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:39.518903 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:39.518904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:39.518905 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:39.518909 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:39.518926 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:39.518931 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:39.518997 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:39.519121 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 21:05:39.519136 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 21:05:39.519896 16796 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:39.532399 16796 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5b6e1edcfc1492393f403177a786de1: Generated new TSK 0
I20260808 21:05:39.532644 16796 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:39.535686 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16679
W20260808 21:05:39.551023 16656 connection.cc:535] client connection to 127.14.146.254:39947 recv error: Network error: failed to read from TLS socket (remote: 127.14.146.254:39947): Connection reset by peer (error 104)
2026-08-08T21:05:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1566 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:39 dist-test-slave-t3q3 krb5kdc[16821](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:39 dist-test-slave-t3q3 krb5kdc[16821](info): set up 2 sockets
Aug 08 21:05:39 dist-test-slave-t3q3 krb5kdc[16821](info): commencing operation
krb5kdc: starting...
W20260808 21:05:40.797427 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:40 dist-test-slave-t3q3 krb5kdc[16821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:40.927448 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:33781
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:33781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:41.021347 16852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:41.021598 16852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:41.021631 16852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:41.022805 16852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:41.022842 16852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:41.022856 16852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:41.022869 16852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:41.022881 16852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:41.024333 16852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:33781
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:33781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:41.024541 16852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:41.024726 16852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:41.030014 16859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:41.029979 16861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:41.030030 16852 server_base.cc:1034] running on GCE node
W20260808 21:05:41.029994 16858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:41.030583 16852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:41.030910 16852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:41.032135 16852 hybrid_clock.cc:648] HybridClock initialized: now 1786223141032109 us; error 42 us; skew 500 ppm
Aug 08 21:05:41 dist-test-slave-t3q3 krb5kdc[16821](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223141, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:41.034886 16852 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:41.035455 16852 webserver.cc:460] Webserver started at http://127.14.146.254:35551/ using document root <none> and password file <none>
I20260808 21:05:41.035701 16852 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:41.035774 16852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:41.035917 16852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:41.037104 16852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "9db338bcd2e74fc3b0a4c7d340722d8e"
format_stamp: "Formatted at 2026-08-08 21:05:41 on dist-test-slave-t3q3"
server_key: "6e83c645c648e0df98200615df9660c7"
server_key_iv: "f57d20ae761ff3c167cb508e7465ea17"
server_key_version: "encryptionkey@0"
I20260808 21:05:41.037499 16852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "9db338bcd2e74fc3b0a4c7d340722d8e"
format_stamp: "Formatted at 2026-08-08 21:05:41 on dist-test-slave-t3q3"
server_key: "6e83c645c648e0df98200615df9660c7"
server_key_iv: "f57d20ae761ff3c167cb508e7465ea17"
server_key_version: "encryptionkey@0"
I20260808 21:05:41.038972 16852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:41.039810 16871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:41.040112 16852 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:05:41.040247 16852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "9db338bcd2e74fc3b0a4c7d340722d8e"
format_stamp: "Formatted at 2026-08-08 21:05:41 on dist-test-slave-t3q3"
server_key: "6e83c645c648e0df98200615df9660c7"
server_key_iv: "f57d20ae761ff3c167cb508e7465ea17"
server_key_version: "encryptionkey@0"
I20260808 21:05:41.040347 16852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:41.044189 16852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:41.046842 16852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:41.047029 16852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:41.051647 16852 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:33781
I20260808 21:05:41.051685 16951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:33781 every 8 connection(s)
I20260808 21:05:41.052130 16852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:41.053037 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 16852
I20260808 21:05:41.053193 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:41.053377 16952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:41.053424 14923 external_mini_cluster.cc:1428] Setting key 44a9ec6fec62caf5b20a2c3ff5bc4aed
I20260808 21:05:41.056350 16957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:41.053995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33923 (local address 127.14.146.254:33781)
0808 21:05:41.054193 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:41.054211 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:41.054246 (+ 35us) server_negotiation.cc:407] Connection header received
0808 21:05:41.054915 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:41.054923 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:41.054951 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:41.055089 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:41.055816 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:41.055820 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:41.055821 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:41.055825 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:41.055868 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:41.055881 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:41.055945 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:41.056042 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 21:05:41.056136 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260808 21:05:41.056951 16952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e: Bootstrap starting.
I20260808 21:05:41.057466 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:41.057761 16952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:41.058195 16952 log.cc:824] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:41.059059 16952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e: No bootstrap required, opened a new log
I20260808 21:05:41.060009 16957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:41.059034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46235 (local address 127.14.146.254:33781)
0808 21:05:41.059076 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:41.059078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:41.059227 (+ 149us) server_negotiation.cc:407] Connection header received
0808 21:05:41.059279 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:41.059280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:41.059284 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:41.059328 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:41.059840 (+ 512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:41.059841 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:41.059841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:41.059844 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:41.059857 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:41.059860 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:41.059903 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:41.059957 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 21:05:41.059967 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:05:41.061574 16952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9db338bcd2e74fc3b0a4c7d340722d8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33781 } }
I20260808 21:05:41.061720 16952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:41.061743 16952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9db338bcd2e74fc3b0a4c7d340722d8e, State: Initialized, Role: FOLLOWER
I20260808 21:05:41.061826 16952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9db338bcd2e74fc3b0a4c7d340722d8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33781 } }
I20260808 21:05:41.061893 16952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:41.061915 16952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:41.061944 16952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:41.062479 16952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9db338bcd2e74fc3b0a4c7d340722d8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33781 } }
I20260808 21:05:41.062568 16952 leader_election.cc:302] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9db338bcd2e74fc3b0a4c7d340722d8e; no voters:
I20260808 21:05:41.062753 16952 leader_election.cc:288] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:41.062816 16970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:41.062996 16970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [term 1 LEADER]: Becoming Leader. State: Replica: 9db338bcd2e74fc3b0a4c7d340722d8e, State: Running, Role: LEADER
I20260808 21:05:41.063020 16952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:41.063117 16970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9db338bcd2e74fc3b0a4c7d340722d8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33781 } }
I20260808 21:05:41.063551 16974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9db338bcd2e74fc3b0a4c7d340722d8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9db338bcd2e74fc3b0a4c7d340722d8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33781 } } }
I20260808 21:05:41.063568 16978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9db338bcd2e74fc3b0a4c7d340722d8e. Latest consensus state: current_term: 1 leader_uuid: "9db338bcd2e74fc3b0a4c7d340722d8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9db338bcd2e74fc3b0a4c7d340722d8e" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 33781 } } }
I20260808 21:05:41.063902 16978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:41.064160 16974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:41.064189 16987 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:41.064858 16987 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:41.066395 16987 catalog_manager.cc:1347] Generated new cluster ID: 5d27f248924b40849952ec95b148a4ed
I20260808 21:05:41.066453 16987 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:41.076628 16987 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:41.076828 16987 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:41.086109 16987 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9db338bcd2e74fc3b0a4c7d340722d8e: Generated new TSK 0
I20260808 21:05:41.086323 16987 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:41.091137 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 16852
2026-08-08T21:05:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1554 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:41 dist-test-slave-t3q3 krb5kdc[17008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:41 dist-test-slave-t3q3 krb5kdc[17008](info): set up 2 sockets
Aug 08 21:05:41 dist-test-slave-t3q3 krb5kdc[17008](info): commencing operation
krb5kdc: starting...
W20260808 21:05:42.359824 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:42 dist-test-slave-t3q3 krb5kdc[17008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:42.490896 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:44297
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:40441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:44297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:42.575466 17025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:42.575706 17025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:42.575747 17025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:42.576905 17025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:42.576982 17025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:42.577009 17025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:42.577041 17025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:42.577069 17025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:42.578540 17025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:40441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:44297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:44297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:42.578821 17025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:42.579047 17025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:42.584033 17040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:42.584110 17036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:42.584221 17037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:42.584336 17025 server_base.cc:1034] running on GCE node
I20260808 21:05:42.584573 17025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:42.584903 17025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:42.586076 17025 hybrid_clock.cc:648] HybridClock initialized: now 1786223142586035 us; error 56 us; skew 500 ppm
Aug 08 21:05:42 dist-test-slave-t3q3 krb5kdc[17008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223142, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:42.588733 17025 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:42.589233 17025 webserver.cc:460] Webserver started at http://127.14.146.254:35793/ using document root <none> and password file <none>
I20260808 21:05:42.589424 17025 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:42.589465 17025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:42.589560 17025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:42.590595 17025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "2e5004caf1574b1486774176ff5ffe2b"
format_stamp: "Formatted at 2026-08-08 21:05:42 on dist-test-slave-t3q3"
server_key: "cb5c47bb7e907dd5449d72cd8b099cd0"
server_key_iv: "77ed81594f06c0085ae63888f9c2becf"
server_key_version: "encryptionkey@0"
I20260808 21:05:42.590914 17025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "2e5004caf1574b1486774176ff5ffe2b"
format_stamp: "Formatted at 2026-08-08 21:05:42 on dist-test-slave-t3q3"
server_key: "cb5c47bb7e907dd5449d72cd8b099cd0"
server_key_iv: "77ed81594f06c0085ae63888f9c2becf"
server_key_version: "encryptionkey@0"
I20260808 21:05:42.592308 17025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 21:05:42.593072 17055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:42.593297 17025 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:42.593398 17025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "2e5004caf1574b1486774176ff5ffe2b"
format_stamp: "Formatted at 2026-08-08 21:05:42 on dist-test-slave-t3q3"
server_key: "cb5c47bb7e907dd5449d72cd8b099cd0"
server_key_iv: "77ed81594f06c0085ae63888f9c2becf"
server_key_version: "encryptionkey@0"
I20260808 21:05:42.593477 17025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:42.608655 17025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:42.610576 17025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:42.610749 17025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:42.615425 17025 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:44297
I20260808 21:05:42.615463 17158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:44297 every 8 connection(s)
I20260808 21:05:42.615954 17025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:42.616838 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17025
I20260808 21:05:42.616958 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:42.617054 17160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:42.617185 14923 external_mini_cluster.cc:1428] Setting key e1766d9154ba57ff6eb758e7a123b6fa
I20260808 21:05:42.620468 17160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b: Bootstrap starting.
I20260808 21:05:42.621255 17160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:42.621572 17160 log.cc:824] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:42.622383 17160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b: No bootstrap required, opened a new log
Aug 08 21:05:42 dist-test-slave-t3q3 krb5kdc[17008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:42.625105 17160 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e5004caf1574b1486774176ff5ffe2b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44297 } }
I20260808 21:05:42.625272 17160 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:42.625324 17160 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e5004caf1574b1486774176ff5ffe2b, State: Initialized, Role: FOLLOWER
I20260808 21:05:42.625468 17160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e5004caf1574b1486774176ff5ffe2b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44297 } }
I20260808 21:05:42.625564 17160 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:42.625602 17160 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:42.625701 17160 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:42.626415 17160 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e5004caf1574b1486774176ff5ffe2b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44297 } }
I20260808 21:05:42.626545 17160 leader_election.cc:302] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e5004caf1574b1486774176ff5ffe2b; no voters:
I20260808 21:05:42.626768 17160 leader_election.cc:288] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:42.626792 17173 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:42.626982 17173 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [term 1 LEADER]: Becoming Leader. State: Replica: 2e5004caf1574b1486774176ff5ffe2b, State: Running, Role: LEADER
I20260808 21:05:42.627076 17160 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:42.627177 17173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e5004caf1574b1486774176ff5ffe2b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44297 } }
I20260808 21:05:42.627638 17173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e5004caf1574b1486774176ff5ffe2b. Latest consensus state: current_term: 1 leader_uuid: "2e5004caf1574b1486774176ff5ffe2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e5004caf1574b1486774176ff5ffe2b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44297 } } }
I20260808 21:05:42.627681 17176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e5004caf1574b1486774176ff5ffe2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e5004caf1574b1486774176ff5ffe2b" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 44297 } } }
I20260808 21:05:42.627794 17176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:42.627770 17173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:42.629238 17169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:42.617737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34263 (local address 127.14.146.254:44297)
0808 21:05:42.617929 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:42.617937 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:42.617962 (+ 25us) server_negotiation.cc:407] Connection header received
0808 21:05:42.618574 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:42.618580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:42.618627 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:42.618791 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:42.619601 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:42.620694 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:42.621809 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:42.622360 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:42.622447 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:42.625160 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:42.625164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:42.625164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:42.625187 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:42.627267 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:42.627833 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:42.627838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:42.627838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:42.628009 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:42.628306 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:42.628306 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:42.628307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:42.628629 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:42.628783 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:42.628908 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 21:05:42.629060 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":97,"threads_started":1}
W20260808 21:05:42.629241 17207 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:05:42.629318 17207 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:05:42.629361 17197 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:42.629509 17197 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:42.630247 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:42.632035 17197 catalog_manager.cc:1347] Generated new cluster ID: 43f1fc687bc94ca1b1dbf97125fc2746
I20260808 21:05:42.632117 17197 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:42.638131 17169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:42.631886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48957 (local address 127.14.146.254:44297)
0808 21:05:42.631922 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:42.631924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:42.631994 (+ 70us) server_negotiation.cc:407] Connection header received
0808 21:05:42.632135 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:42.632136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:42.632148 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:42.632177 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:42.632718 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:42.633216 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:42.633979 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:42.634232 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:42.634325 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:42.635505 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:42.635506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:42.635507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:42.635513 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:42.636998 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:42.637370 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:42.637371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:42.637371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:42.637425 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:42.637633 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:42.637634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:42.637634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:42.637748 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:42.637849 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:42.637959 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 21:05:42.638033 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:05:42.650888 17197 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:42.651398 17197 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:42.656663 17197 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e5004caf1574b1486774176ff5ffe2b: Generated new TSK 0
I20260808 21:05:42.656864 17197 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:42.662268 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17025
2026-08-08T21:05:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1569 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:42 dist-test-slave-t3q3 krb5kdc[17219](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:42 dist-test-slave-t3q3 krb5kdc[17219](info): set up 2 sockets
Aug 08 21:05:42 dist-test-slave-t3q3 krb5kdc[17219](info): commencing operation
krb5kdc: starting...
W20260808 21:05:43.924319 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:44 dist-test-slave-t3q3 krb5kdc[17219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:44.059999 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:41683
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:43791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:41683
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:44.144188 17238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:44.144397 17238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:44.144419 17238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:44.145500 17238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:44.145545 17238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:44.145560 17238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:44.145572 17238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:44.145584 17238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:44.146999 17238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:43791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:41683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:41683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:44.147193 17238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:44.147367 17238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:44.152338 17243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:44.152359 17248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:44.152403 17245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:44.152772 17238 server_base.cc:1034] running on GCE node
I20260808 21:05:44.153075 17238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:44.153373 17238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:44.154528 17238 hybrid_clock.cc:648] HybridClock initialized: now 1786223144154504 us; error 40 us; skew 500 ppm
Aug 08 21:05:44 dist-test-slave-t3q3 krb5kdc[17219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223144, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:44.161162 17238 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:44.161692 17238 webserver.cc:460] Webserver started at http://127.14.146.254:34313/ using document root <none> and password file <none>
I20260808 21:05:44.161971 17238 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:44.162045 17238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:44.162197 17238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:44.163270 17238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "bc6dd08fc0d44316936e5e4789a4c9d7"
format_stamp: "Formatted at 2026-08-08 21:05:44 on dist-test-slave-t3q3"
server_key: "76caea18ba94692b3368470577564228"
server_key_iv: "5ab4026e9991e2f285d53e99f53ed411"
server_key_version: "encryptionkey@0"
I20260808 21:05:44.163642 17238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "bc6dd08fc0d44316936e5e4789a4c9d7"
format_stamp: "Formatted at 2026-08-08 21:05:44 on dist-test-slave-t3q3"
server_key: "76caea18ba94692b3368470577564228"
server_key_iv: "5ab4026e9991e2f285d53e99f53ed411"
server_key_version: "encryptionkey@0"
I20260808 21:05:44.165144 17238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:44.165922 17264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:44.166131 17238 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:05:44.166240 17238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "bc6dd08fc0d44316936e5e4789a4c9d7"
format_stamp: "Formatted at 2026-08-08 21:05:44 on dist-test-slave-t3q3"
server_key: "76caea18ba94692b3368470577564228"
server_key_iv: "5ab4026e9991e2f285d53e99f53ed411"
server_key_version: "encryptionkey@0"
I20260808 21:05:44.166323 17238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:44.182300 17238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:44.184376 17238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:44.184566 17238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:44.188927 17238 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:41683
I20260808 21:05:44.188974 17358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:41683 every 8 connection(s)
I20260808 21:05:44.189355 17238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:44.190332 17359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:44.192736 17359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7: Bootstrap starting.
I20260808 21:05:44.193292 17359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:44.193524 17359 log.cc:824] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:44.194188 17359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7: No bootstrap required, opened a new log
I20260808 21:05:44.195708 17359 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc6dd08fc0d44316936e5e4789a4c9d7" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } }
I20260808 21:05:44.195866 17359 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:44.195891 17359 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6dd08fc0d44316936e5e4789a4c9d7, State: Initialized, Role: FOLLOWER
I20260808 21:05:44.196102 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17238
I20260808 21:05:44.196115 17359 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc6dd08fc0d44316936e5e4789a4c9d7" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } }
I20260808 21:05:44.196214 17359 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:44.196225 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:44.196257 17359 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:44.196305 17359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:44.196410 14923 external_mini_cluster.cc:1428] Setting key 5ce0c03290be430119426d2f5d7c6802
I20260808 21:05:44.197397 17359 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc6dd08fc0d44316936e5e4789a4c9d7" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } }
I20260808 21:05:44.197548 17359 leader_election.cc:302] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc6dd08fc0d44316936e5e4789a4c9d7; no voters:
I20260808 21:05:44.197731 17359 leader_election.cc:288] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:44.197755 17368 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:44.197944 17368 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [term 1 LEADER]: Becoming Leader. State: Replica: bc6dd08fc0d44316936e5e4789a4c9d7, State: Running, Role: LEADER
I20260808 21:05:44.197988 17359 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:44.198071 17368 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc6dd08fc0d44316936e5e4789a4c9d7" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } }
I20260808 21:05:44.198480 17368 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc6dd08fc0d44316936e5e4789a4c9d7. Latest consensus state: current_term: 1 leader_uuid: "bc6dd08fc0d44316936e5e4789a4c9d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc6dd08fc0d44316936e5e4789a4c9d7" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } } }
I20260808 21:05:44.198738 17368 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:44.198640 17369 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc6dd08fc0d44316936e5e4789a4c9d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc6dd08fc0d44316936e5e4789a4c9d7" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 41683 } } }
I20260808 21:05:44.199185 17369 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:44.199373 17387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:44.200003 17387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:44.201905 17387 catalog_manager.cc:1347] Generated new cluster ID: d9770b67b4cb4fa5910f2f23c2478578
I20260808 21:05:44.202008 17387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:44.202248 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:44.196943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47231 (local address 127.14.146.254:41683)
0808 21:05:44.197149 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:44.197157 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:44.197190 (+ 33us) server_negotiation.cc:407] Connection header received
0808 21:05:44.197285 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:44.197291 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:44.197333 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:44.197441 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:44.197741 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:44.199295 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:44.200257 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:44.200747 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:44.200864 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:44.201534 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:44.201538 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:44.201538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:44.201754 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:44.201794 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:44.201810 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:44.201878 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:44.201974 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 21:05:44.202046 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":114,"threads_started":1}
I20260808 21:05:44.203143 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:44.211655 17367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:44.204568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48847 (local address 127.14.146.254:41683)
0808 21:05:44.204604 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:44.204606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:44.208263 (+ 3657us) server_negotiation.cc:407] Connection header received
0808 21:05:44.208361 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:44.208362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:44.208374 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:44.208440 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:44.208574 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:44.209346 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:44.210312 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:44.210642 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:44.210716 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:44.211409 (+ 693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:44.211411 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:44.211411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:44.211416 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:44.211432 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:44.211436 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:44.211495 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:44.211549 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 21:05:44.211576 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":21}
I20260808 21:05:44.217376 17387 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:44.217850 17387 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:44.223807 17387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc6dd08fc0d44316936e5e4789a4c9d7: Generated new TSK 0
I20260808 21:05:44.223995 17387 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:44.226272 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17238
2026-08-08T21:05:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1562 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:44 dist-test-slave-t3q3 krb5kdc[17414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:44 dist-test-slave-t3q3 krb5kdc[17414](info): set up 2 sockets
Aug 08 21:05:44 dist-test-slave-t3q3 krb5kdc[17414](info): commencing operation
krb5kdc: starting...
W20260808 21:05:45.471822 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:45 dist-test-slave-t3q3 krb5kdc[17414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:45.599690 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:40841
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:45425
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:40841
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:45.684877 17436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:45.685151 17436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:45.685196 17436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:45.686384 17436 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:45.686473 17436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:45.686499 17436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:45.686549 17436 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:45.686580 17436 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:45.688359 17436 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:45425
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:40841
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:40841
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:45.688665 17436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:45.688915 17436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:45.694139 17447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:45.694139 17444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:45.694320 17436 server_base.cc:1034] running on GCE node
W20260808 21:05:45.694419 17445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:45.694682 17436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:45.695091 17436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:45.696259 17436 hybrid_clock.cc:648] HybridClock initialized: now 1786223145696238 us; error 36 us; skew 500 ppm
Aug 08 21:05:45 dist-test-slave-t3q3 krb5kdc[17414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223145, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:45.698807 17436 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:45.699198 17436 webserver.cc:460] Webserver started at http://127.14.146.254:41563/ using document root <none> and password file <none>
I20260808 21:05:45.699465 17436 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:45.699540 17436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:45.699690 17436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:45.700817 17436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "471351672f2b46fba68809ffa6c73886"
format_stamp: "Formatted at 2026-08-08 21:05:45 on dist-test-slave-t3q3"
server_key: "a0a51a77841c2ed4c1beb4c7da4786f4"
server_key_iv: "0943c55a6bd337d61a9294e2aa068046"
server_key_version: "encryptionkey@0"
I20260808 21:05:45.701190 17436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "471351672f2b46fba68809ffa6c73886"
format_stamp: "Formatted at 2026-08-08 21:05:45 on dist-test-slave-t3q3"
server_key: "a0a51a77841c2ed4c1beb4c7da4786f4"
server_key_iv: "0943c55a6bd337d61a9294e2aa068046"
server_key_version: "encryptionkey@0"
I20260808 21:05:45.702539 17436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:05:45.703267 17457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:45.703450 17436 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:45.703560 17436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "471351672f2b46fba68809ffa6c73886"
format_stamp: "Formatted at 2026-08-08 21:05:45 on dist-test-slave-t3q3"
server_key: "a0a51a77841c2ed4c1beb4c7da4786f4"
server_key_iv: "0943c55a6bd337d61a9294e2aa068046"
server_key_version: "encryptionkey@0"
I20260808 21:05:45.703639 17436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:45.707214 17436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:45.709209 17436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:45.709373 17436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:45.713768 17436 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:40841
I20260808 21:05:45.713804 17549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:40841 every 8 connection(s)
I20260808 21:05:45.714151 17436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:45.715205 17551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:45.715248 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17436
I20260808 21:05:45.715355 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:45.715570 14923 external_mini_cluster.cc:1428] Setting key 8a8f305dae3604feeb949eedf06dacde
I20260808 21:05:45.718145 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:45.716177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60889 (local address 127.14.146.254:40841)
0808 21:05:45.716382 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:45.716391 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:45.716423 (+ 32us) server_negotiation.cc:407] Connection header received
0808 21:05:45.716863 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:45.716870 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:45.716895 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:45.717055 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:45.717725 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:45.717730 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:45.717730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:45.717735 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:45.717786 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:45.717797 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:45.717881 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:45.717951 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 21:05:45.717993 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":80,"threads_started":1}
I20260808 21:05:45.718554 17551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886: Bootstrap starting.
I20260808 21:05:45.719221 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:45.719367 17551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:45.719663 17551 log.cc:824] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:45.720485 17551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886: No bootstrap required, opened a new log
I20260808 21:05:45.721911 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:45.720814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43079 (local address 127.14.146.254:40841)
0808 21:05:45.720858 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:45.720860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:45.720956 (+ 96us) server_negotiation.cc:407] Connection header received
0808 21:05:45.721035 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:45.721037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:45.721042 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:45.721097 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:45.721704 (+ 607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:45.721705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:45.721706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 21:05:45.721710 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:45.721724 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 21:05:45.721728 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:45.721775 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:45.721831 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 21:05:45.721845 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:05:45.722837 17551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471351672f2b46fba68809ffa6c73886" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40841 } }
I20260808 21:05:45.722980 17551 raft_consensus.cc:374] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 21:05:45.723002 17551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 471351672f2b46fba68809ffa6c73886, State: Initialized, Role: FOLLOWER
I20260808 21:05:45.723147 17551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471351672f2b46fba68809ffa6c73886" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40841 } }
I20260808 21:05:45.723237 17551 raft_consensus.cc:388] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 21:05:45.723285 17551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 21:05:45.723340 17551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:45.723927 17551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471351672f2b46fba68809ffa6c73886" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40841 } }
I20260808 21:05:45.724022 17551 leader_election.cc:302] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 471351672f2b46fba68809ffa6c73886; no voters:
I20260808 21:05:45.724262 17551 leader_election.cc:288] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 21:05:45.724341 17569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:45.724509 17569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [term 1 LEADER]: Becoming Leader. State: Replica: 471351672f2b46fba68809ffa6c73886, State: Running, Role: LEADER
I20260808 21:05:45.724536 17551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:45.724644 17569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471351672f2b46fba68809ffa6c73886" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40841 } }
I20260808 21:05:45.725014 17571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "471351672f2b46fba68809ffa6c73886" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471351672f2b46fba68809ffa6c73886" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40841 } } }
I20260808 21:05:45.725138 17571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:45.725033 17572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 471351672f2b46fba68809ffa6c73886. Latest consensus state: current_term: 1 leader_uuid: "471351672f2b46fba68809ffa6c73886" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "471351672f2b46fba68809ffa6c73886" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 40841 } } }
I20260808 21:05:45.725293 17572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:45.725687 17580 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:45.726186 17580 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:45.727743 17580 catalog_manager.cc:1347] Generated new cluster ID: c800d1bb56084d8cb823c4145080a4f4
I20260808 21:05:45.727799 17580 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:45.735145 17580 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:45.735368 17580 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:45.742763 17580 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 471351672f2b46fba68809ffa6c73886: Generated new TSK 0
I20260808 21:05:45.742980 17580 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:45.753098 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17436
2026-08-08T21:05:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1535 ms)
[----------] 18 tests from AuthTokenIssuingTest (28088 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:45 dist-test-slave-t3q3 krb5kdc[17600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:45 dist-test-slave-t3q3 krb5kdc[17600](info): set up 2 sockets
Aug 08 21:05:45 dist-test-slave-t3q3 krb5kdc[17600](info): commencing operation
krb5kdc: starting...
W20260808 21:05:47.015393 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:47.140275 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45323
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45323,127.14.146.253:39207,127.14.146.252:39483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:47.224610 17621 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 21:05:47.224889 17621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:47.224922 17621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:47.224960 17621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:47.226104 17621 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:47.226178 17621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:47.226213 17621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:47.226243 17621 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:47.226264 17621 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:47.227751 17621 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45323,127.14.146.253:39207,127.14.146.252:39483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:45323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:47.228029 17621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:47.228302 17621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:47.233659 17630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:47.233688 17627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:47.233688 17634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:47.233712 17621 server_base.cc:1034] running on GCE node
I20260808 21:05:47.234148 17621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:47.234454 17621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:47.235639 17621 hybrid_clock.cc:648] HybridClock initialized: now 1786223147235612 us; error 46 us; skew 500 ppm
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:47.238394 17621 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:47.238914 17621 webserver.cc:460] Webserver started at http://127.14.146.254:43823/ using document root <none> and password file <none>
I20260808 21:05:47.239177 17621 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:47.239252 17621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:47.239408 17621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:47.240590 17621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "b0ef71a4259b4e20a17795a5a80e6966"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "ab96affbad570aac75b475b263c8b9c1"
server_key_iv: "eb132804385a69b5fb39f5238d8600ee"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.240973 17621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "b0ef71a4259b4e20a17795a5a80e6966"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "ab96affbad570aac75b475b263c8b9c1"
server_key_iv: "eb132804385a69b5fb39f5238d8600ee"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.242344 17621 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:47.243114 17646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:47.243314 17621 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:47.243429 17621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "b0ef71a4259b4e20a17795a5a80e6966"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "ab96affbad570aac75b475b263c8b9c1"
server_key_iv: "eb132804385a69b5fb39f5238d8600ee"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.243508 17621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:47.264767 17621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:47.267164 17621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:47.267338 17621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:47.271693 17621 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:45323
I20260808 21:05:47.271737 17729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:45323 every 8 connection(s)
I20260808 21:05:47.272285 17621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:47.272979 17731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:47.274516 17731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:47.275763 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17621
I20260808 21:05:47.275851 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:47.276036 14923 external_mini_cluster.cc:1428] Setting key 81bc85d1877d20865f9e5f9849e293eb
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:47.284617 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.275208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40148 (local address 127.14.146.254:45323)
0808 21:05:47.275363 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.275368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.275407 (+ 39us) server_negotiation.cc:407] Connection header received
0808 21:05:47.275994 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.275995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.276012 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.276181 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.276731 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.277554 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.278460 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.278771 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.278911 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.281381 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.281389 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.281389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.281396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.282956 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.283431 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.283433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.283434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.283512 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.283786 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.283787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.283787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.283990 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.284052 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.284355 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.284461 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.14.146.253@KRBTEST.COM; defaulting to no policy
I20260808 21:05:47.284731 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.275126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45323 (local address 127.0.0.1:40148)
0808 21:05:47.275296 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.275337 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.275793 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.276187 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.276190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.276462 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.276620 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.276624 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.277677 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.277679 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.278344 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.278346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.278885 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.278886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.278961 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.279473 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.279482 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.281278 (+ 1796us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.283049 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.283057 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.283059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.283339 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.283587 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.283588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.283588 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.283709 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.284108 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.284117 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.284203 (+ 86us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.284313 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.284567 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":89,"thread_start_us":92,"threads_started":1}
I20260808 21:05:47.285455 17731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:47.285871 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.285680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51528)
0808 21:05:47.285807 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.285853 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
W20260808 21:05:47.286024 17653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
I20260808 21:05:47.286403 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.286345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51538)
0808 21:05:47.286366 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.286389 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260808 21:05:47.286533 17731 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:39207: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab.
Entry for principal kudu/127.14.146.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab.
I20260808 21:05:47.301433 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.253:39207
--webserver_interface=127.14.146.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab
--principal=kudu/127.14.146.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45323,127.14.146.253:39207,127.14.146.252:39483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:05:47.335839 17731 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } attempt: 1
I20260808 21:05:47.336416 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.336278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51546)
0808 21:05:47.336344 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.336384 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 21:05:47.336874 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.336782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51560)
0808 21:05:47.336831 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.336858 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 21:05:47.337009 17731 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:39207: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
W20260808 21:05:47.386759 17742 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 21:05:47.386984 17742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:47.387002 17742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:47.387022 17742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:47.388227 17742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:47.388273 17742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:47.388286 17742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:47.388299 17742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:47.388312 17742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:47.389812 17742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45323,127.14.146.253:39207,127.14.146.252:39483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab
--principal=kudu/127.14.146.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.253:39207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.146.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:47.390021 17742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:47.390190 17742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:47.395426 17747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:47.395433 17751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:47.395609 17742 server_base.cc:1034] running on GCE node
W20260808 21:05:47.395433 17755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:47.395972 17742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:47.396304 17742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:47.397485 17742 hybrid_clock.cc:648] HybridClock initialized: now 1786223147397469 us; error 48 us; skew 500 ppm
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:47.400336 17742 init.cc:377] Logged in from keytab as kudu/127.14.146.253@KRBTEST.COM (short username kudu)
I20260808 21:05:47.400825 17742 webserver.cc:460] Webserver started at http://127.14.146.253:44131/ using document root <none> and password file <none>
I20260808 21:05:47.401072 17742 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:47.401144 17742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:47.401289 17742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:47.402390 17742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/data/instance:
uuid: "595e7b5831a04512b648b19b4001d570"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "cd0520afe7bfd7343680c58911119bcc"
server_key_iv: "860fefcad20d70237257b685511ca4de"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.402761 17742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/wal/instance:
uuid: "595e7b5831a04512b648b19b4001d570"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "cd0520afe7bfd7343680c58911119bcc"
server_key_iv: "860fefcad20d70237257b685511ca4de"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.404206 17742 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 21:05:47.405035 17767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:47.405265 17742 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:47.405220 17731 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } attempt: 2
I20260808 21:05:47.405364 17742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/wal
uuid: "595e7b5831a04512b648b19b4001d570"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "cd0520afe7bfd7343680c58911119bcc"
server_key_iv: "860fefcad20d70237257b685511ca4de"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.405452 17742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:47.405653 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.405508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51574)
0808 21:05:47.405584 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.405616 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 21:05:47.406049 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.405926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51590)
0808 21:05:47.405988 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.406024 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 21:05:47.406160 17731 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:39207: Network error: Client connection negotiation failed: client connection to 127.14.146.253:39207: connect: Connection refused (error 111)
I20260808 21:05:47.422768 17742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:47.424798 17742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:47.424955 17742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:47.429056 17742 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.253:39207
I20260808 21:05:47.429095 17843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.253:39207 every 8 connection(s)
I20260808 21:05:47.429471 17742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
I20260808 21:05:47.430395 17846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:47.431921 17846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:47.437160 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17742
I20260808 21:05:47.437290 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-1/wal/instance
I20260808 21:05:47.437479 14923 external_mini_cluster.cc:1428] Setting key e72f0a85cd95fd1e1caaefa33b3bb1e6
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:47.441812 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.432693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40152 (local address 127.14.146.254:45323)
0808 21:05:47.432777 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.432780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.432960 (+ 180us) server_negotiation.cc:407] Connection header received
0808 21:05:47.433451 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.433452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.433464 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.433519 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.434137 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.434629 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.435591 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.435816 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.435882 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.438218 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.438220 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.438220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.438229 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.439928 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.440518 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.440520 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.440520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.440590 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.440938 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.440939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.440940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.441095 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.441169 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.441568 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.441669 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 21:05:47.442445 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.432644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45323 (local address 127.0.0.1:40152)
0808 21:05:47.432840 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.432879 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.433368 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.433598 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.433601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.433844 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.434048 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.434052 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.434718 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.434718 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.435510 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.435512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.435902 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.435903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.436004 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.436528 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.436536 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.438107 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.440016 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.440051 (+ 35us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.440054 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.440423 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.440669 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.440670 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.440671 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.440845 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.441209 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.441217 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.441395 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.441920 (+ 525us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.442122 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.14.146.252@KRBTEST.COM; defaulting to no policy
I20260808 21:05:47.449517 17846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.252@KRBTEST.COM" created.
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
I20260808 21:05:47.457978 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.449849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51596)
0808 21:05:47.450077 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.450089 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.450140 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.450322 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.450323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.450527 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.450592 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.450594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.451755 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.451756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.452340 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.452343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.452869 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.452870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.452937 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.453437 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.453442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.454944 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.456837 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.456838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.456839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.457010 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.457267 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.457268 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.457268 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.457326 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.457640 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.457641 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.457682 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.457747 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.457853 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211}
I20260808 21:05:47.458015 17851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.449922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51596 (local address 127.14.146.253:39207)
0808 21:05:47.450125 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.450131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.450160 (+ 29us) server_negotiation.cc:407] Connection header received
0808 21:05:47.450189 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.450191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.450228 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.450310 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.450687 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.451655 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.452435 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.452772 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.452870 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.455043 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.455052 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.455052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.455059 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.456731 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.457135 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.457138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.457138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.457197 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.457397 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.457398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.457398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.457553 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.457664 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.457776 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.457909 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260808 21:05:47.458666 17846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:47.459043 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.458918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36408)
0808 21:05:47.458966 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.459012 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 21:05:47.459237 17770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
I20260808 21:05:47.459723 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.459628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36412)
0808 21:05:47.459681 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.459706 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 21:05:47.459853 17846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:39483: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab.
Entry for principal kudu/127.14.146.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab.
I20260808 21:05:47.468874 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.252:39483
--webserver_interface=127.14.146.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab
--principal=kudu/127.14.146.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:44373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:45323,127.14.146.253:39207,127.14.146.252:39483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:05:47.497328 17731 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } attempt: 3
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
I20260808 21:05:47.505828 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.497812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51612)
0808 21:05:47.497884 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.497896 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.497941 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.498163 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.498164 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.498372 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.498466 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.498468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.499452 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.499453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.500339 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.500342 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.500765 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.500767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.500846 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.501318 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.501324 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.502877 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.504679 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.504680 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.504681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.504866 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.505131 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.505132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.505132 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.505195 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.505468 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.505469 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.505543 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.505614 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.505724 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 21:05:47.505828 17851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.497915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51612 (local address 127.14.146.253:39207)
0808 21:05:47.497965 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.497967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.497981 (+ 14us) server_negotiation.cc:407] Connection header received
0808 21:05:47.498013 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.498014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.498026 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.498145 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.498551 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.499364 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.500443 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.500686 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.500746 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.503001 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.503003 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.503003 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.503017 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.504572 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.504958 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.504960 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.504960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.505047 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.505269 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.505269 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.505270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.505389 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.505465 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.505654 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.505729 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:05:47.506490 17731 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:47.506860 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.506757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36426)
0808 21:05:47.506806 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.506838 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 21:05:47.507184 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.507127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36440)
0808 21:05:47.507149 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.507170 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260808 21:05:47.507289 17731 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:39483: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
I20260808 21:05:47.509117 17846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } attempt: 1
I20260808 21:05:47.509516 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.509396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36452)
0808 21:05:47.509454 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.509487 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 21:05:47.509922 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.509805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36468)
0808 21:05:47.509854 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.509888 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 21:05:47.510028 17846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:39483: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
I20260808 21:05:47.538444 17731 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } attempt: 1
I20260808 21:05:47.539026 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.538877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36478)
0808 21:05:47.538951 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.538996 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 21:05:47.539409 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.539328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36490)
0808 21:05:47.539369 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.539393 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 21:05:47.539520 17731 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:39483: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
W20260808 21:05:47.556528 17856 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 21:05:47.556740 17856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:47.556759 17856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:47.556779 17856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:47.557940 17856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:47.557981 17856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:47.557996 17856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:47.558046 17856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:47.558066 17856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:47.559547 17856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:44373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:45323,127.14.146.253:39207,127.14.146.252:39483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab
--principal=kudu/127.14.146.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.252:39483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.146.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:47.559811 17856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:47.560050 17856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:47.564900 17869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:47.564906 17867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:47.565169 17856 server_base.cc:1034] running on GCE node
W20260808 21:05:47.564906 17872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:47.565531 17856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:47.565827 17856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:47.566992 17856 hybrid_clock.cc:648] HybridClock initialized: now 1786223147566979 us; error 44 us; skew 500 ppm
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:47.569605 17856 init.cc:377] Logged in from keytab as kudu/127.14.146.252@KRBTEST.COM (short username kudu)
I20260808 21:05:47.570081 17856 webserver.cc:460] Webserver started at http://127.14.146.252:38571/ using document root <none> and password file <none>
I20260808 21:05:47.570325 17856 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:47.570395 17856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:47.570555 17856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:47.571631 17856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/data/instance:
uuid: "b019aec78ec847fcbd1e0fab566595b0"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "37fd9c4b5f6d653da20afd8441407e78"
server_key_iv: "e04fd466edefafa324241d2e4b940a8e"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.572013 17856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/wal/instance:
uuid: "b019aec78ec847fcbd1e0fab566595b0"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "37fd9c4b5f6d653da20afd8441407e78"
server_key_iv: "e04fd466edefafa324241d2e4b940a8e"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.573398 17856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:47.574108 17881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:47.574285 17856 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 21:05:47.574391 17856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/wal
uuid: "b019aec78ec847fcbd1e0fab566595b0"
format_stamp: "Formatted at 2026-08-08 21:05:47 on dist-test-slave-t3q3"
server_key: "37fd9c4b5f6d653da20afd8441407e78"
server_key_iv: "e04fd466edefafa324241d2e4b940a8e"
server_key_version: "encryptionkey@0"
I20260808 21:05:47.574466 17856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:47.578171 17846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } attempt: 2
I20260808 21:05:47.578549 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.578430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36502)
0808 21:05:47.578488 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.578522 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 21:05:47.578894 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.578792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36508)
0808 21:05:47.578839 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.578865 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 21:05:47.578987 17846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:39483: Network error: Client connection negotiation failed: client connection to 127.14.146.252:39483: connect: Connection refused (error 111)
I20260808 21:05:47.584136 17856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:47.586464 17856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:47.586634 17856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:47.590801 17856 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.252:39483
I20260808 21:05:47.590837 17964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.252:39483 every 8 connection(s)
I20260808 21:05:47.591228 17856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
I20260808 21:05:47.592199 17968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:47.593739 17968 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:47.594962 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 17856
I20260808 21:05:47.595054 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786222870463854-14923-0/minicluster-data/master-2/wal/instance
I20260808 21:05:47.595296 14923 external_mini_cluster.cc:1428] Setting key 1dd7b66175474f178820d7ae6b6a5452
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
I20260808 21:05:47.603585 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.594443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40156 (local address 127.14.146.254:45323)
0808 21:05:47.594496 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.594498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.594688 (+ 190us) server_negotiation.cc:407] Connection header received
0808 21:05:47.595253 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.595255 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.595267 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.595324 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.596173 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.596669 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.597623 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.597834 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.597912 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.600495 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.600496 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.600497 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.600503 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.601968 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.602494 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.602496 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.602496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.602560 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.602844 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.602845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.602845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.602967 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.603019 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.603388 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.603471 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 21:05:47.603669 17971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.594389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:45323 (local address 127.0.0.1:40156)
0808 21:05:47.594556 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.594598 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.595133 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.595393 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.595397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.595726 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.596042 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.596049 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.596767 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.596768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.597532 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.597534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.597920 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.597921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.598066 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.598626 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.598636 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.600404 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.602051 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.602059 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.602061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.602411 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.602631 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.602632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.602632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.602772 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.603038 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.603044 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.603205 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.603333 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.603474 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260808 21:05:47.604251 17968 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:47.604701 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.595743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36518 (local address 127.14.146.252:39483)
0808 21:05:47.595877 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.595881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.595944 (+ 63us) server_negotiation.cc:407] Connection header received
0808 21:05:47.596005 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.596007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.596024 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.596156 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.596786 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.597536 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.598525 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.598897 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.598954 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.601408 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.601416 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.601416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.601423 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.603286 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.603669 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.603671 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.603672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.603757 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.604104 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.604105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.604105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.604269 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.604433 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.604521 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.604582 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:47.611773 17971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.604537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:39207 (local address 127.0.0.1:51620)
0808 21:05:47.604643 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.604653 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.604691 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.604897 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.604898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.605048 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.605099 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.605101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.605914 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.605915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.606597 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.606600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.607098 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.607099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.607169 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.607501 (+ 332us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.607505 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.609027 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.610745 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.610746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.610746 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.610915 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.611124 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.611125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.611126 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.611193 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.611452 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.611453 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.611496 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.611584 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.611677 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260808 21:05:47.611773 17851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.604697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51620 (local address 127.14.146.253:39207)
0808 21:05:47.604756 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.604758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.604768 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:47.604797 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.604798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.604810 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.604876 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.605187 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.605836 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.606686 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.607003 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.607060 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.609125 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.609127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.609127 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.609135 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.610665 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.610992 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.610993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.610994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.611048 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.611264 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.611265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.611265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.611382 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.611459 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.611610 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.611687 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 21:05:47.612468 17968 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:47.613595 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.605660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40168 (local address 127.14.146.254:45323)
0808 21:05:47.605697 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.605699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.605708 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:47.605728 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.605729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.605736 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.605799 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.606337 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.606869 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.607760 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.607999 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.608116 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.610588 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.610589 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.610589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.610595 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.612378 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.612725 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.612726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.612727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.612787 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.613037 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.613038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.613038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.613183 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.613391 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.613474 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.613533 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:05:47.614671 17731 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } attempt: 2
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
I20260808 21:05:47.619233 17971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.612749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36526)
0808 21:05:47.612834 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.612844 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.612887 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.613034 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.613034 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.613183 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.613222 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.613224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.614074 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.614075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.614711 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.614713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.615186 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.615187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.615233 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.615620 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.615625 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.616762 (+ 1137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.618190 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.618191 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.618192 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.618353 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.618557 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.618558 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.618558 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.618613 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.618908 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.618909 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.618959 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.619029 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.619124 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 21:05:47.619426 17975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.612790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.14.146.252:39483)
0808 21:05:47.612830 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.612832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.612876 (+ 44us) server_negotiation.cc:407] Connection header received
0808 21:05:47.612944 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.612945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.612958 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.613022 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.613311 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.614012 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.614793 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.615072 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.615134 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.616860 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.616862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.616862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.616868 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.618081 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.618437 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.618438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.618438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.618493 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.618692 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.618693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.618694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.618835 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.618902 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.619081 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.619189 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":21}
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
I20260808 21:05:47.621356 17968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0: Bootstrap starting.
I20260808 21:05:47.622077 17968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:47.622427 17968 log.cc:824] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:47.623409 17968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0: No bootstrap required, opened a new log
I20260808 21:05:47.623533 17851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.614291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51624 (local address 127.14.146.253:39207)
0808 21:05:47.614328 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.614330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.614338 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:05:47.614359 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.614359 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.614367 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.614427 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.614958 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.615605 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.616577 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.616856 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.616897 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.620563 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.620564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.620565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.620572 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.622310 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.622714 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.622715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.622715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.622771 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.622975 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.622976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.622977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.623114 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.623307 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.623344 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.623418 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:05:47.623620 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.614907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36532)
0808 21:05:47.615000 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.615010 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.615047 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.615320 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.615321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.615484 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.615528 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.615530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.616537 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.616538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.617322 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.617325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.618509 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.618510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.618578 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.618978 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.618984 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.620532 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.622443 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.622444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.622445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.622677 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.622923 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.622924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.622924 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.622991 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.623316 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.623317 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.623366 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.623414 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.623517 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 21:05:47.624042 17979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.614995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36532 (local address 127.14.146.252:39483)
0808 21:05:47.615184 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.615186 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.615193 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:05:47.615211 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.615212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.615226 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.615302 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.615626 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.616431 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.617428 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.618415 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.618508 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.620607 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.620609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.620609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.620616 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.622362 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.622760 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.622762 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.622762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.622825 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.623067 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.623069 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.623069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.623227 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.623790 (+ 563us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.623843 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.623918 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":99,"threads_started":1}
I20260808 21:05:47.625065 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:47.625465 17968 raft_consensus.cc:348] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } }
I20260808 21:05:47.625581 17968 raft_consensus.cc:729] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b019aec78ec847fcbd1e0fab566595b0, State: Initialized, Role: FOLLOWER
I20260808 21:05:47.625638 17968 consensus_queue.cc:260] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } }
I20260808 21:05:47.625873 17981 sys_catalog.cc:455] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.625929 17968 sys_catalog.cc:564] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:47.625953 17981 sys_catalog.cc:458] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:47.626037 17731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966: Bootstrap starting.
I20260808 21:05:47.626715 17731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:47.626988 17731 log.cc:824] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:47.626103 17689 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b0ef71a4259b4e20a17795a5a80e6966"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40168
I20260808 21:05:47.627980 17731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966: No bootstrap required, opened a new log
W20260808 21:05:47.627830 18007 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:05:47.628382 18007 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:05:47.629434 17731 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } }
I20260808 21:05:47.629578 17731 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0ef71a4259b4e20a17795a5a80e6966, State: Initialized, Role: FOLLOWER
I20260808 21:05:47.629660 17731 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } }
I20260808 21:05:47.629984 17731 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:47.630084 18011 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.630232 18011 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:47.628893 17856 master_runner.cc:186] Error getting master registration for 127.14.146.254:45323: OK, instance_id { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" instance_seqno: 1786223147270462 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 21:05:47.631422 17856 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 21:05:47.631552 17689 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 21:05:47.631767 17689 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [term 0 FOLLOWER]: Advancing to term 1
W20260808 21:05:47.632009 18027 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:05:47.632095 18027 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:05:47.632578 17689 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } }
I20260808 21:05:47.632856 17689 leader_election.cc:288] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [CANDIDATE]: Term 1 election: Requested vote from peers 595e7b5831a04512b648b19b4001d570 (127.14.146.253:39207), b019aec78ec847fcbd1e0fab566595b0 (127.14.146.252:39483)
I20260808 21:05:47.633426 17926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0ef71a4259b4e20a17795a5a80e6966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b019aec78ec847fcbd1e0fab566595b0"
I20260808 21:05:47.633536 17926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:47.634445 17926 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ef71a4259b4e20a17795a5a80e6966 in term 1.
I20260808 21:05:47.634707 17649 leader_election.cc:302] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b019aec78ec847fcbd1e0fab566595b0, b0ef71a4259b4e20a17795a5a80e6966; no voters:
I20260808 21:05:47.634827 18011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:47.635015 18011 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [term 1 LEADER]: Becoming Leader. State: Replica: b0ef71a4259b4e20a17795a5a80e6966, State: Running, Role: LEADER
I20260808 21:05:47.635113 18011 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } }
I20260808 21:05:47.636137 17621 master_runner.cc:186] Error getting master registration for 127.14.146.253:39207: OK, instance_id { permanent_uuid: "595e7b5831a04512b648b19b4001d570" instance_seqno: 1786223147427907 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 21:05:47.638499 17621 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 21:05:47.642637 17851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.634031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51640 (local address 127.14.146.253:39207)
0808 21:05:47.634075 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.634077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.634263 (+ 186us) server_negotiation.cc:407] Connection header received
0808 21:05:47.634343 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.634344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.634354 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.634409 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.635208 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.635941 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.637459 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.637766 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.637816 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.639712 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.639713 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.639714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.639735 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.641421 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.641810 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.641811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.641812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.641868 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.642082 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.642082 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.642083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.642198 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.642308 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.642430 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.642516 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:05:47.644322 18038 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0ef71a4259b4e20a17795a5a80e6966. Latest consensus state: current_term: 1 leader_uuid: "b0ef71a4259b4e20a17795a5a80e6966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.644438 18038 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:47.644721 18044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:47.645116 18044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:47.649739 17735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.640769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40174 (local address 127.14.146.254:45323)
0808 21:05:47.640810 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.640812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.642714 (+ 1902us) server_negotiation.cc:407] Connection header received
0808 21:05:47.642831 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.642832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.642845 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.642877 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.643508 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.643964 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.644954 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.645240 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.645286 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.646852 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.646853 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.646854 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.646860 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.648545 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.648918 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.648919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.648919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.648974 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.649203 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.649203 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.649204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.649319 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.649454 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.649558 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.649637 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:05:47.658710 17979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.641145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36546 (local address 127.14.146.252:39483)
0808 21:05:47.641193 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.641195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.645670 (+ 4475us) server_negotiation.cc:407] Connection header received
0808 21:05:47.645793 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.645794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.645804 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.645835 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.652197 (+ 6362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.652952 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.653944 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.654181 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.654276 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.655733 (+ 1457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.655734 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.655735 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.655743 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.657390 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.657792 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.657793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.657794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.657847 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.658048 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.658049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.658050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.658210 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.658310 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.658496 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.658581 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 21:05:47.659956 17926 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [term 1 FOLLOWER]: Refusing update from remote peer b0ef71a4259b4e20a17795a5a80e6966: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:47.660328 18011 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:47.661759 17981 sys_catalog.cc:455] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0ef71a4259b4e20a17795a5a80e6966. Latest consensus state: current_term: 1 leader_uuid: "b0ef71a4259b4e20a17795a5a80e6966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.661850 17981 sys_catalog.cc:458] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:47.670113 17846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } attempt: 3
I20260808 21:05:47.671685 18011 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b0ef71a4259b4e20a17795a5a80e6966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.671806 18011 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:47.671907 18045 mvcc.cc:205] Tried to move back new op lower bound from 7316370012812341248 to 7316370012714151936. Current Snapshot: MvccSnapshot[applied={T|T < 7316370012812341248}]
I20260808 21:05:47.672885 18047 mvcc.cc:205] Tried to move back new op lower bound from 7316370012812341248 to 7316370012714151936. Current Snapshot: MvccSnapshot[applied={T|T < 7316370012812341248}]
I20260808 21:05:47.673619 17981 sys_catalog.cc:455] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b0ef71a4259b4e20a17795a5a80e6966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.673707 17981 sys_catalog.cc:458] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0 [sys.catalog]: This master's current role is: FOLLOWER
Aug 08 21:05:47 dist-test-slave-t3q3 krb5kdc[17600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223147, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
I20260808 21:05:47.678298 18044 catalog_manager.cc:1347] Generated new cluster ID: c2c7af9e97c84fb19dd7b55b9ff9342e
I20260808 21:05:47.678354 18044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:47.679250 17849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.670424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:39483 (local address 127.0.0.1:36558)
0808 21:05:47.670484 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:47.670498 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:47.670551 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:47.670691 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:47.670692 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:47.670898 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:47.670955 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.670957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.672570 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.672571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.673430 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:47.673434 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.673953 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.673954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:47.674015 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.674596 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:47.674602 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:47.676171 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:47.678195 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.678196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.678197 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.678422 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.678655 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:47.678656 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:47.678656 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:47.678714 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:47.678956 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:47.678957 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:47.679000 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 21:05:47.679056 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 21:05:47.679152 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 21:05:47.679502 17979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:47.670544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36558 (local address 127.14.146.252:39483)
0808 21:05:47.670585 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.670587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.670595 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:05:47.670617 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.670618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.670627 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.670685 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.671018 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.671704 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.673522 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:47.673812 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:47.673875 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:47.676254 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:47.676256 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:47.676257 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:47.676266 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:47.678079 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.678509 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.678510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.678511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.678574 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:47.678771 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:47.678771 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:47.678772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:47.678887 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:47.678936 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:47.679351 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 21:05:47.679419 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:05:47.683362 17846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570: Bootstrap starting.
I20260808 21:05:47.684183 17846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:47.684494 17846 log.cc:824] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:47.685503 17846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570: No bootstrap required, opened a new log
I20260808 21:05:47.687582 17846 raft_consensus.cc:348] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } }
I20260808 21:05:47.687861 17846 raft_consensus.cc:729] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 595e7b5831a04512b648b19b4001d570, State: Initialized, Role: FOLLOWER
I20260808 21:05:47.687968 17846 consensus_queue.cc:260] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } }
I20260808 21:05:47.688328 17846 sys_catalog.cc:564] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:47.688380 17805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0ef71a4259b4e20a17795a5a80e6966" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "595e7b5831a04512b648b19b4001d570"
I20260808 21:05:47.688506 17805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:47.688849 18044 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:47.689363 17805 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0ef71a4259b4e20a17795a5a80e6966 in term 1.
I20260808 21:05:47.689534 17804 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [term 1 FOLLOWER]: Refusing update from remote peer b0ef71a4259b4e20a17795a5a80e6966: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:47.690120 18011 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [LEADER]: Connected to new peer: Peer: permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:47.690883 18044 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:47.692910 18074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0ef71a4259b4e20a17795a5a80e6966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.693018 18074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:47.693079 18074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0ef71a4259b4e20a17795a5a80e6966. Latest consensus state: current_term: 1 leader_uuid: "b0ef71a4259b4e20a17795a5a80e6966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.693122 18074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:47.693148 18074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b0ef71a4259b4e20a17795a5a80e6966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.693183 18074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:47.693725 18044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966: Generated new TSK 0
I20260808 21:05:47.693888 18044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 21:05:47.696808 18072 catalog_manager.cc:1259] Loaded cluster ID: c2c7af9e97c84fb19dd7b55b9ff9342e
I20260808 21:05:47.696856 18072 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570: loading cluster ID for follower catalog manager: success
I20260808 21:05:47.696842 18038 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b0ef71a4259b4e20a17795a5a80e6966" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0ef71a4259b4e20a17795a5a80e6966" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 45323 } } peers { permanent_uuid: "595e7b5831a04512b648b19b4001d570" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 39207 } } peers { permanent_uuid: "b019aec78ec847fcbd1e0fab566595b0" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 39483 } } }
I20260808 21:05:47.696947 18038 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0ef71a4259b4e20a17795a5a80e6966 [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:47.698012 18072 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570: acquiring CA information for follower catalog manager: success
W20260808 21:05:47.698390 18072 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
W20260808 21:05:47.717329 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.715665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51646 (local address 127.14.146.253:39207)
0808 21:05:47.715710 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.715712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.716658 (+ 946us) server_negotiation.cc:407] Connection header received
0808 21:05:47.716770 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.716772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.716784 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.716815 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.717261 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51646: BlockingRecv error: recv got EOF from 127.0.0.1:51646 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 21:05:47.718096 17735 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.716151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40178 (local address 127.14.146.254:45323)
0808 21:05:47.716193 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.716195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.717580 (+ 1385us) server_negotiation.cc:407] Connection header received
0808 21:05:47.717696 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.717698 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.717708 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.717737 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.718036 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40178: BlockingRecv error: recv got EOF from 127.0.0.1:40178 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 21:05:47.718829 17979 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.716454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36562 (local address 127.14.146.252:39483)
0808 21:05:47.716502 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.716504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.718296 (+ 1792us) server_negotiation.cc:407] Connection header received
0808 21:05:47.718422 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.718424 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.718435 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.718464 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.718766 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36562: BlockingRecv error: recv got EOF from 127.0.0.1:36562 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 21:05:47.720837 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.720056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51658 (local address 127.14.146.253:39207)
0808 21:05:47.720131 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.720132 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.720322 (+ 190us) server_negotiation.cc:407] Connection header received
0808 21:05:47.720425 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.720426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.720444 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.720473 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.720790 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51658: BlockingRecv error: recv got EOF from 127.0.0.1:51658 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 21:05:47.723798 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.723072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51672 (local address 127.14.146.253:39207)
0808 21:05:47.723104 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.723106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.723311 (+ 205us) server_negotiation.cc:407] Connection header received
0808 21:05:47.723403 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.723404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.723413 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.723441 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.723753 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51672: BlockingRecv error: recv got EOF from 127.0.0.1:51672 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 21:05:47.737119 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.732316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51686 (local address 127.14.146.253:39207)
0808 21:05:47.732353 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.732355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.736328 (+ 3973us) server_negotiation.cc:407] Connection header received
0808 21:05:47.736442 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.736443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.736456 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.736485 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.737060 (+ 575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51686: BlockingRecv error: recv got EOF from 127.0.0.1:51686 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 21:05:47.743245 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.742372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51688 (local address 127.14.146.253:39207)
0808 21:05:47.742414 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.742416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.742678 (+ 262us) server_negotiation.cc:407] Connection header received
0808 21:05:47.742797 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.742797 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.742809 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.742839 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.743190 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51688: BlockingRecv error: recv got EOF from 127.0.0.1:51688 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 21:05:47.753330 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.752416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51692 (local address 127.14.146.253:39207)
0808 21:05:47.752455 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.752457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.752737 (+ 280us) server_negotiation.cc:407] Connection header received
0808 21:05:47.752845 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.752846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.752859 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.752888 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.753272 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51692: BlockingRecv error: recv got EOF from 127.0.0.1:51692 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 21:05:47.771624 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.770626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51708 (local address 127.14.146.253:39207)
0808 21:05:47.770671 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.770674 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.770988 (+ 314us) server_negotiation.cc:407] Connection header received
0808 21:05:47.771104 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.771105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.771117 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.771149 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.771562 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51708: BlockingRecv error: recv got EOF from 127.0.0.1:51708 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 21:05:47.806097 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.805110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51714 (local address 127.14.146.253:39207)
0808 21:05:47.805163 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.805165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.805462 (+ 297us) server_negotiation.cc:407] Connection header received
0808 21:05:47.805570 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.805571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.805583 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.805613 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.806033 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51714: BlockingRecv error: recv got EOF from 127.0.0.1:51714 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 21:05:47.872546 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:47.871638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51728 (local address 127.14.146.253:39207)
0808 21:05:47.871739 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:47.871741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:47.871850 (+ 109us) server_negotiation.cc:407] Connection header received
0808 21:05:47.871945 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:47.871947 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:47.871959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:47.872038 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:47.872452 (+ 414us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51728: BlockingRecv error: recv got EOF from 127.0.0.1:51728 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 21:05:48.002846 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:48.001938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51732 (local address 127.14.146.253:39207)
0808 21:05:48.002034 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:48.002036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:48.002062 (+ 26us) server_negotiation.cc:407] Connection header received
0808 21:05:48.002155 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:48.002156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:48.002168 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:48.002225 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:48.002751 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51732: BlockingRecv error: recv got EOF from 127.0.0.1:51732 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 21:05:48.260910 17851 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:48.260225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51742 (local address 127.14.146.253:39207)
0808 21:05:48.260331 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:48.260334 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:48.260346 (+ 12us) server_negotiation.cc:407] Connection header received
0808 21:05:48.260378 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:48.260379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:48.260391 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:48.260477 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:48.260861 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51742: BlockingRecv error: recv got EOF from 127.0.0.1:51742 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 21:05:48.628907 18007 catalog_manager.cc:1259] Loaded cluster ID: c2c7af9e97c84fb19dd7b55b9ff9342e
I20260808 21:05:48.628990 18007 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0: loading cluster ID for follower catalog manager: success
I20260808 21:05:48.629889 18007 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0: acquiring CA information for follower catalog manager: success
I20260808 21:05:48.630160 18007 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b019aec78ec847fcbd1e0fab566595b0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:05:48.699043 18072 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 595e7b5831a04512b648b19b4001d570: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:05:48.776913 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:48.774317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51752 (local address 127.14.146.253:39207)
0808 21:05:48.774423 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:48.774425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:48.774487 (+ 62us) server_negotiation.cc:407] Connection header received
0808 21:05:48.774547 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:48.774548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:48.774593 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:48.774675 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:48.774809 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.775316 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.776120 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.776329 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.776385 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:48.776534 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:48.776694 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:48.776777 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:48.776813 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 21:05:48.776836 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":64,"threads_started":1}
I20260808 21:05:48.781251 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:48.778882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36574 (local address 127.14.146.252:39483)
0808 21:05:48.778974 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:48.778976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:48.779039 (+ 63us) server_negotiation.cc:407] Connection header received
0808 21:05:48.779133 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:48.779133 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:48.779169 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:48.779239 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:48.779393 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.779866 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.780627 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.780821 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.780872 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:48.780995 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:48.781086 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:48.781139 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:48.781176 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 21:05:48.781191 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74,"thread_start_us":50,"threads_started":1}
I20260808 21:05:48.786021 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:48.783084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36576 (local address 127.14.146.252:39483)
0808 21:05:48.783124 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:48.783126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:48.783220 (+ 94us) server_negotiation.cc:407] Connection header received
0808 21:05:48.783304 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:48.783305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:48.783315 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:48.783367 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:48.783543 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.784297 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.785264 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.785553 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.785622 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:48.785788 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:48.785822 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:48.785874 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:48.785924 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 21:05:48.785944 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:05:48.786598 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:48.782891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51766 (local address 127.14.146.253:39207)
0808 21:05:48.783062 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:48.783065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:48.783190 (+ 125us) server_negotiation.cc:407] Connection header received
0808 21:05:48.783261 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:48.783262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:48.783274 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:48.783324 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:48.784155 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.784910 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.785829 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.786129 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.786184 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:48.786346 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:48.786383 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:48.786437 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:48.786486 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 21:05:48.786508 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260808 21:05:48.787139 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:48.782930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40194 (local address 127.14.146.254:45323)
0808 21:05:48.783131 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:48.783133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:48.783142 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:48.783187 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:48.783188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:48.783239 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:48.783318 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:48.783499 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.784298 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.786053 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:48.786373 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:48.786434 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:48.786700 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:48.786821 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:48.786885 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:48.787060 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 21:05:48.787082 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":86,"threads_started":1}
I20260808 21:05:48.788916 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17621
I20260808 21:05:48.806802 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17742
I20260808 21:05:48.817488 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 17856
2026-08-08T21:05:48Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3056 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 21:05:48 dist-test-slave-t3q3 krb5kdc[18225](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 21:05:48 dist-test-slave-t3q3 krb5kdc[18225](info): set up 2 sockets
Aug 08 21:05:48 dist-test-slave-t3q3 krb5kdc[18225](info): commencing operation
krb5kdc: starting...
W20260808 21:05:50.085054 14923 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/test-user.keytab.
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T21:05:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T21:05:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
Entry for principal kudu/127.14.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab.
I20260808 21:05:50.214610 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43525
--webserver_interface=127.14.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:43525,127.14.146.253:41101,127.14.146.252:33893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 21:05:50.297109 18246 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 21:05:50.297338 18246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:50.297358 18246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:50.297431 18246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:50.298746 18246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:50.298792 18246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:50.298807 18246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:50.298822 18246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:50.298884 18246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:50.300606 18246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:43525,127.14.146.253:41101,127.14.146.252:33893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.254.keytab
--principal=kudu/127.14.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.254:43525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:50.300901 18246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:50.301177 18246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:50.306773 18256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:50.306840 18263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:50.306778 18261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:50.307021 18246 server_base.cc:1034] running on GCE node
I20260808 21:05:50.307317 18246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:50.307605 18246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:50.308796 18246 hybrid_clock.cc:648] HybridClock initialized: now 1786223150308779 us; error 27 us; skew 500 ppm
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:50.317938 18246 init.cc:377] Logged in from keytab as kudu/127.14.146.254@KRBTEST.COM (short username kudu)
I20260808 21:05:50.318426 18246 webserver.cc:460] Webserver started at http://127.14.146.254:33061/ using document root <none> and password file <none>
I20260808 21:05:50.318684 18246 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:50.318761 18246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:50.318919 18246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:50.320030 18246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/data/instance:
uuid: "dc481b8df6a1479996a6bfb883e90eaf"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "f0f773c49565b959c88ecd6b3746ccb7"
server_key_iv: "ad169c2d411b20e43e259fb1f5bf0cef"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.320495 18246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/wal/instance:
uuid: "dc481b8df6a1479996a6bfb883e90eaf"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "f0f773c49565b959c88ecd6b3746ccb7"
server_key_iv: "ad169c2d411b20e43e259fb1f5bf0cef"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.322012 18246 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 21:05:50.322781 18276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:50.323014 18246 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:50.323133 18246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/wal
uuid: "dc481b8df6a1479996a6bfb883e90eaf"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "f0f773c49565b959c88ecd6b3746ccb7"
server_key_iv: "ad169c2d411b20e43e259fb1f5bf0cef"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.323216 18246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:50.339576 18246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:50.341861 18246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:50.342080 18246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:50.346500 18246 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.254:43525
I20260808 21:05:50.346540 18350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.254:43525 every 8 connection(s)
I20260808 21:05:50.346935 18246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/data/info.pb
I20260808 21:05:50.347901 18352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:50.349532 18352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:50.350085 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 18246
I20260808 21:05:50.350207 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-0/wal/instance
I20260808 21:05:50.350431 14923 external_mini_cluster.cc:1428] Setting key dadd59eebf4f9373e2a4e7411d6ce69d
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.146.253@KRBTEST.COM; defaulting to no policy
I20260808 21:05:50.360375 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.350336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43525 (local address 127.0.0.1:48256)
0808 21:05:50.350555 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.350595 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.351129 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.351439 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.351442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.351736 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.351894 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.351899 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.353030 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.353031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.354035 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.354038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.354550 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.354552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.354650 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.355276 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.355287 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.356964 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.358765 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.358772 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.358774 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.358974 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.359248 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.359249 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.359249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.359341 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.359741 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.359746 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.359809 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.359926 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.360193 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":124,"thread_start_us":92,"threads_started":1}
I20260808 21:05:50.360380 18362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.350366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48256 (local address 127.14.146.254:43525)
0808 21:05:50.350540 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.350551 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.350714 (+ 163us) server_negotiation.cc:407] Connection header received
0808 21:05:50.351295 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.351297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.351323 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.351421 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.352003 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.352890 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.354140 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.354451 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.354534 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.357076 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.357084 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.357084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.357093 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.358661 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.359075 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.359078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.359079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.359171 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.359447 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.359447 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.359448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.359662 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.359761 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.359960 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.360126 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":100,"threads_started":1}
I20260808 21:05:50.361300 18352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:50.361665 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.361563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57382)
0808 21:05:50.361596 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.361643 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 21:05:50.361816 18279 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.253@KRBTEST.COM" created.
I20260808 21:05:50.362311 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.362197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57394)
0808 21:05:50.362257 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.362286 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 21:05:50.362422 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:41101: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab.
Entry for principal kudu/127.14.146.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab.
I20260808 21:05:50.379197 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.253:41101
--webserver_interface=127.14.146.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab
--principal=kudu/127.14.146.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:43525,127.14.146.253:41101,127.14.146.252:33893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:05:50.411684 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } attempt: 1
I20260808 21:05:50.412343 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.412182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57396)
0808 21:05:50.412254 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.412306 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 21:05:50.412742 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.412631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57398)
0808 21:05:50.412691 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.412721 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 21:05:50.412881 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:41101: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
W20260808 21:05:50.464864 18371 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 21:05:50.465070 18371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:50.465087 18371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:50.465107 18371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:50.466274 18371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:50.466313 18371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:50.466327 18371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:50.466341 18371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:50.466388 18371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:50.467844 18371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:43525,127.14.146.253:41101,127.14.146.252:33893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.253.keytab
--principal=kudu/127.14.146.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.253:41101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.146.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:50.468116 18371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:50.468364 18371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:50.473393 18385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:50.473464 18381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:50.473402 18383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:50.473688 18371 server_base.cc:1034] running on GCE node
I20260808 21:05:50.473945 18371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:50.474283 18371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:50.475481 18371 hybrid_clock.cc:648] HybridClock initialized: now 1786223150475467 us; error 46 us; skew 500 ppm
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:50.478240 18371 init.cc:377] Logged in from keytab as kudu/127.14.146.253@KRBTEST.COM (short username kudu)
I20260808 21:05:50.478695 18371 webserver.cc:460] Webserver started at http://127.14.146.253:39123/ using document root <none> and password file <none>
I20260808 21:05:50.478926 18371 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:50.478996 18371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:50.479156 18371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:50.480414 18371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/data/instance:
uuid: "852412f37ad44dc5905d2f0c353d7561"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "cd5ce64822e03c1f0d856d8e57af92e2"
server_key_iv: "d9429fcee1c9248673f8ff17d2f7fc71"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.480937 18371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/wal/instance:
uuid: "852412f37ad44dc5905d2f0c353d7561"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "cd5ce64822e03c1f0d856d8e57af92e2"
server_key_iv: "d9429fcee1c9248673f8ff17d2f7fc71"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.481043 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } attempt: 2
I20260808 21:05:50.481525 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.481363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57410)
0808 21:05:50.481451 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.481497 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 21:05:50.481848 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.481797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57420)
0808 21:05:50.481821 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.481839 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 21:05:50.481956 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.253:41101: Network error: Client connection negotiation failed: client connection to 127.14.146.253:41101: connect: Connection refused (error 111)
I20260808 21:05:50.482714 18371 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 21:05:50.483572 18398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:50.483758 18371 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 21:05:50.483848 18371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/wal
uuid: "852412f37ad44dc5905d2f0c353d7561"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "cd5ce64822e03c1f0d856d8e57af92e2"
server_key_iv: "d9429fcee1c9248673f8ff17d2f7fc71"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.483904 18371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:50.495473 18371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:50.497812 18371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:50.497923 18371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:50.501828 18371 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.253:41101
I20260808 21:05:50.501886 18487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.253:41101 every 8 connection(s)
I20260808 21:05:50.502241 18371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/data/info.pb
I20260808 21:05:50.503167 18488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:50.504669 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 18371
I20260808 21:05:50.504776 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-1/wal/instance
I20260808 21:05:50.504961 14923 external_mini_cluster.cc:1428] Setting key e776cc6208ca163527af47a47d85b8c8
I20260808 21:05:50.505090 18488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.146.252@KRBTEST.COM; defaulting to no policy
I20260808 21:05:50.515345 18362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.505946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48268 (local address 127.14.146.254:43525)
0808 21:05:50.506023 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.506026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.506273 (+ 247us) server_negotiation.cc:407] Connection header received
0808 21:05:50.507042 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.507043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.507062 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.507134 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.507744 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.508538 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.509512 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.509867 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.509954 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.512354 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.512355 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.512356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.512366 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.514020 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.514446 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.514447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.514448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.514518 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.514799 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.514801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.514801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.514926 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.514985 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.515217 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.515280 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 21:05:50.515496 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.505861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43525 (local address 127.0.0.1:48268)
0808 21:05:50.506129 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.506177 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.506911 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.507199 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.507202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.507447 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.507650 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.507654 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.508630 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.508631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.509411 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.509413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.509959 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.509960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.510064 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.510582 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.510590 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.512253 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.514119 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.514126 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.514127 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.514361 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.514607 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.514608 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.514608 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.514721 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.514989 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.514994 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.515102 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.515185 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.515301 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":105,"threads_started":1}
I20260808 21:05:50.516309 18488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.146.252@KRBTEST.COM" created.
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
I20260808 21:05:50.524274 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.516593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57428)
0808 21:05:50.516647 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.516657 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.516705 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.517014 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.517015 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.517128 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.517179 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.517180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.518101 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.518102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.518929 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.518932 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.519403 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.519404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.519484 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.519846 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.519852 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.521128 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.523014 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.523016 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.523016 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.523269 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.523494 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.523495 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.523496 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.523567 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.523842 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.523843 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.523889 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.523966 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.524104 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 21:05:50.524297 18494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.516707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57428 (local address 127.14.146.253:41101)
0808 21:05:50.516874 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.516884 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.516902 (+ 18us) server_negotiation.cc:407] Connection header received
0808 21:05:50.516920 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.516921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.516932 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.516990 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.517256 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.518013 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.519015 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.519318 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.519377 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.521221 (+ 1844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.521230 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.521230 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.521238 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.522919 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.523362 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.523364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.523364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.523417 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.523636 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.523636 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.523637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.523768 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.523831 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.524008 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.524180 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":137,"thread_start_us":88,"threads_started":1}
I20260808 21:05:50.524931 18488 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:50.525272 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.525160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48748)
0808 21:05:50.525212 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.525254 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 21:05:50.525455 18401 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
I20260808 21:05:50.525879 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.525789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48758)
0808 21:05:50.525839 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.525863 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 21:05:50.526028 18488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:33893: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.146.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab.
Entry for principal kudu/127.14.146.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab.
I20260808 21:05:50.534660 14923 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
/tmp/dist-test-taskW6SX4Q/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.252:33893
--webserver_interface=127.14.146.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab
--principal=kudu/127.14.146.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.146.212:41321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.146.254:43525,127.14.146.253:41101,127.14.146.252:33893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 21:05:50.573130 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } attempt: 3
I20260808 21:05:50.575270 18488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } attempt: 1
I20260808 21:05:50.575703 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.575552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48772)
0808 21:05:50.575614 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.575662 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 21:05:50.576468 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.576330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48788)
0808 21:05:50.576393 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.576429 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 21:05:50.576867 18488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:33893: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
I20260808 21:05:50.580936 18494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.573650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57432 (local address 127.14.146.253:41101)
0808 21:05:50.573730 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.573732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.573760 (+ 28us) server_negotiation.cc:407] Connection header received
0808 21:05:50.573792 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.573793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.573817 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.573890 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.574279 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.574795 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.575716 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.576016 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.576163 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.578246 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.578247 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.578248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.578256 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.579655 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.580016 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.580017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.580018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.580126 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.580387 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.580388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.580388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.580511 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.580591 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.580766 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.580846 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 21:05:50.580941 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.573561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57432)
0808 21:05:50.573632 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.573644 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.573722 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.573898 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.573899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.574084 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.574157 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.574159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.574897 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.574898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.575618 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.575622 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.576250 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.576251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.576313 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.576820 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.576825 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.578151 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.579757 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.579759 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.579759 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.579937 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.580221 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.580222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.580222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.580289 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.580591 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.580593 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.580643 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.580738 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.580846 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 21:05:50.581552 18352 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:50.581887 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.581800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48804)
0808 21:05:50.581834 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.581865 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 21:05:50.582232 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.582178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48818)
0808 21:05:50.582199 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.582219 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260808 21:05:50.582345 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:33893: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
I20260808 21:05:50.613505 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } attempt: 1
I20260808 21:05:50.614207 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.613979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48828)
0808 21:05:50.614088 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.614139 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 21:05:50.614639 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.614533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48840)
0808 21:05:50.614582 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.614613 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 21:05:50.614758 18352 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:33893: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
W20260808 21:05:50.621999 18500 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 21:05:50.622197 18500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 21:05:50.622215 18500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 21:05:50.622236 18500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 21:05:50.623355 18500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 21:05:50.623401 18500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 21:05:50.623416 18500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 21:05:50.623428 18500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 21:05:50.623440 18500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 21:05:50.624933 18500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.146.212:41321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.146.254:43525,127.14.146.253:41101,127.14.146.252:33893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/krb5kdc/kudu_127.14.146.252.keytab
--principal=kudu/127.14.146.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.146.252:33893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.146.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 20:09:30 UTC on ccycloud.quasar-nuvkld.root.comops.site
build id 4575432
I20260808 21:05:50.625130 18500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 21:05:50.625301 18500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 21:05:50.630503 18509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:50.630544 18508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 21:05:50.630542 18511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 21:05:50.630678 18500 server_base.cc:1034] running on GCE node
I20260808 21:05:50.630952 18500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 21:05:50.631294 18500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 21:05:50.632441 18500 hybrid_clock.cc:648] HybridClock initialized: now 1786223150632414 us; error 50 us; skew 500 ppm
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 21:05:50.635072 18500 init.cc:377] Logged in from keytab as kudu/127.14.146.252@KRBTEST.COM (short username kudu)
I20260808 21:05:50.635577 18500 webserver.cc:460] Webserver started at http://127.14.146.252:33823/ using document root <none> and password file <none>
I20260808 21:05:50.635816 18500 fs_manager.cc:359] Metadata directory not provided
I20260808 21:05:50.635890 18500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 21:05:50.636046 18500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 21:05:50.637174 18500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/data/instance:
uuid: "25e0e5bd18b84324882b3d60a33d174c"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "c59cc04b470edcbe31c66a820e3d383a"
server_key_iv: "72b090b21997cdddda1c210e2777857a"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.637557 18500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/wal/instance:
uuid: "25e0e5bd18b84324882b3d60a33d174c"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "c59cc04b470edcbe31c66a820e3d383a"
server_key_iv: "72b090b21997cdddda1c210e2777857a"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.638955 18500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 21:05:50.639724 18526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 21:05:50.639973 18500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 21:05:50.640110 18500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/data,/tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/wal
uuid: "25e0e5bd18b84324882b3d60a33d174c"
format_stamp: "Formatted at 2026-08-08 21:05:50 on dist-test-slave-t3q3"
server_key: "c59cc04b470edcbe31c66a820e3d383a"
server_key_iv: "72b090b21997cdddda1c210e2777857a"
server_key_version: "encryptionkey@0"
I20260808 21:05:50.640208 18500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 21:05:50.645030 18488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } attempt: 2
I20260808 21:05:50.645442 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.645313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48856)
0808 21:05:50.645376 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.645414 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 21:05:50.645824 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.645723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48868)
0808 21:05:50.645773 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.645798 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 21:05:50.645923 18488 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.146.252:33893: Network error: Client connection negotiation failed: client connection to 127.14.146.252:33893: connect: Connection refused (error 111)
I20260808 21:05:50.650321 18500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 21:05:50.652758 18500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 21:05:50.652928 18500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 21:05:50.657086 18500 rpc_server.cc:307] RPC server started. Bound to: 127.14.146.252:33893
I20260808 21:05:50.657146 18616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.146.252:33893 every 8 connection(s)
I20260808 21:05:50.657544 18500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/data/info.pb
I20260808 21:05:50.658442 18618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 21:05:50.659974 18618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:50.660305 14923 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu as pid 18500
I20260808 21:05:50.660405 14923 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskW6SX4Q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786222870463854-14923-0/minicluster-data/master-2/wal/instance
I20260808 21:05:50.660629 14923 external_mini_cluster.cc:1428] Setting key efb6ea616d24f6941bec40a824171210
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
I20260808 21:05:50.670783 18362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.660877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48278 (local address 127.14.146.254:43525)
0808 21:05:50.660954 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.660958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.661171 (+ 213us) server_negotiation.cc:407] Connection header received
0808 21:05:50.661706 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.661707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.661721 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.661781 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.662579 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.663340 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.664565 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.664821 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.664892 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.667328 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.667330 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.667331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.667339 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.669042 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.669648 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.669649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.669649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.669737 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.670043 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.670044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.670044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.670196 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.670260 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.670570 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.670662 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 21:05:50.671031 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.661056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48872 (local address 127.14.146.252:33893)
0808 21:05:50.661211 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.661217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.661299 (+ 82us) server_negotiation.cc:407] Connection header received
0808 21:05:50.661622 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.661634 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.661689 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.661784 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.662587 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.663673 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.664715 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.665105 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.665159 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.667794 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.667802 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.667802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.667809 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.669591 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.669984 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.669987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.669987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.670078 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.670309 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.670310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.670310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.670465 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.670623 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.670703 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.670782 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":60,"threads_started":1}
I20260808 21:05:50.671044 18621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.660864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.254:43525 (local address 127.0.0.1:48278)
0808 21:05:50.661017 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.661060 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.661603 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.661833 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.661836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.662211 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.662459 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.662466 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.663424 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.663425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.664464 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.664467 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.664910 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.664911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.665012 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.665578 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.665589 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.667229 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.669128 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.669134 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.669136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.669535 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.669823 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.669824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.669824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.669971 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.670276 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.670284 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.670430 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.670545 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.670730 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":79,"threads_started":1}
I20260808 21:05:50.671864 18618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.254@KRBTEST.COM
I20260808 21:05:50.679107 18494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.672270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57448 (local address 127.14.146.253:41101)
0808 21:05:50.672320 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.672322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.672329 (+ 7us) server_negotiation.cc:407] Connection header received
0808 21:05:50.672353 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.672354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.672363 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.672436 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.672723 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.673221 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.673896 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.674119 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.674210 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.676192 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.676194 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.676194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.676202 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.677876 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.678270 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.678271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.678271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.678325 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.678537 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.678537 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.678538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.678653 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.678703 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.678904 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.678984 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 21:05:50.679109 18621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.672161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.253:41101 (local address 127.0.0.1:57448)
0808 21:05:50.672221 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.672233 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.672269 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.672440 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.672441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.672581 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.672626 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.672627 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.673303 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.673304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.673798 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.673799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.674210 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.674211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.674290 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.674656 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.674660 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.676041 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.677965 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.677966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.677967 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.678191 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.678398 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.678399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.678399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.678467 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.678727 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.678728 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.678780 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.678852 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.678982 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 21:05:50.679579 18618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } has no permanent_uuid. Determining permanent_uuid...
I20260808 21:05:50.680330 18362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.671996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48284 (local address 127.14.146.254:43525)
0808 21:05:50.672115 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.672118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.672126 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:05:50.672148 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.672149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.672159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.672211 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.672772 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.673245 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.673944 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.674150 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.674242 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.676935 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.676936 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.676937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.676944 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.678708 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.679084 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.679085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.679085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.679147 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.679764 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.679767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.679767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.679926 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.680162 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.680206 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.680271 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.252@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.146.253@KRBTEST.COM
I20260808 21:05:50.686820 18621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.679856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48876)
0808 21:05:50.679907 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.679917 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.679953 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.680089 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.680090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.680266 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.680304 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.680306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.681222 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.681223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.681805 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.681807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.682170 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.682171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.682224 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.682611 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.682614 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.683905 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.685702 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.685703 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.685703 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.685924 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.686171 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.686171 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.686172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.686234 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.686488 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.686489 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.686527 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.686596 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.686711 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 21:05:50.686864 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.679928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.14.146.252:33893)
0808 21:05:50.679967 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.679969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.679977 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:05:50.679999 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.680000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.680011 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.680099 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.680386 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.681146 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.681888 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.682098 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.682149 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.683993 (+ 1844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.683994 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.683994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.684000 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.685613 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.686001 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.686002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.686003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.686063 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.686309 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.686310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.686310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.686419 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.686496 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.686672 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.686759 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":22}
I20260808 21:05:50.688742 18494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.681058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57456 (local address 127.14.146.253:41101)
0808 21:05:50.681102 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.681104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.681150 (+ 46us) server_negotiation.cc:407] Connection header received
0808 21:05:50.681220 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.681221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.681230 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.681293 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.681719 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.682296 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.683080 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.683285 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.683340 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.685835 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.685836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.685836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.685841 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.687501 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.687917 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.687918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.687918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.687976 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.688278 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.688279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.688279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.688387 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.688531 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.688620 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.688683 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 21:05:50.688807 18618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c: Bootstrap starting.
I20260808 21:05:50.689960 18618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:50.689908 18352 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } attempt: 2
I20260808 21:05:50.690299 18618 log.cc:824] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:50.690577 14923 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 21:05:50.691185 18618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c: No bootstrap required, opened a new log
I20260808 21:05:50.691743 18311 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "dc481b8df6a1479996a6bfb883e90eaf"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48284
I20260808 21:05:50.693243 18618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } }
I20260808 21:05:50.693363 18618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e0e5bd18b84324882b3d60a33d174c, State: Initialized, Role: FOLLOWER
I20260808 21:05:50.693470 18618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } }
I20260808 21:05:50.693825 18618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:50.693791 18627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.693900 18627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [sys.catalog]: This master's current role is: FOLLOWER
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.254@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
W20260808 21:05:50.695711 18645 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:05:50.695811 18645 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:05:50.698589 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.690731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48878)
0808 21:05:50.690793 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.690805 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.690851 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.690976 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.690977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.691160 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.691211 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.691213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.692124 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.692125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.692895 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.692898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.693485 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.693486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.693549 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.694000 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.694005 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.695474 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.697392 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.697393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.697393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.697621 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.697844 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.697845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.697845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.697915 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.698268 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.698270 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.698316 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.698392 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.698491 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 21:05:50.698599 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.690828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48878 (local address 127.14.146.252:33893)
0808 21:05:50.690862 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.690864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.690872 (+ 8us) server_negotiation.cc:407] Connection header received
0808 21:05:50.690896 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.690897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.690906 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.690970 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.691308 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.691992 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.692980 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.693354 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.693429 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.695571 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.695572 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.695573 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.695580 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.697285 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.697708 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.697709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.697709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.697770 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.697994 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.697995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.697995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.698161 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.698230 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.698435 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.698516 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 21:05:50.696300 18500 master_runner.cc:186] Error getting master registration for 127.14.146.254:43525: OK, instance_id { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" instance_seqno: 1786223150345284 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 21:05:50.699133 18500 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 21:05:50.700596 18352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf: Bootstrap starting.
I20260808 21:05:50.701316 18352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:50.701625 18352 log.cc:824] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:50.702503 18352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf: No bootstrap required, opened a new log
I20260808 21:05:50.703877 18352 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } }
I20260808 21:05:50.704020 18352 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc481b8df6a1479996a6bfb883e90eaf, State: Initialized, Role: FOLLOWER
I20260808 21:05:50.704186 18352 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } }
I20260808 21:05:50.704478 18652 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.704517 18352 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:50.704532 18311 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 21:05:50.704639 18652 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:50.704741 18311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:50.705549 18311 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } }
I20260808 21:05:50.705806 18311 leader_election.cc:288] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [CANDIDATE]: Term 1 election: Requested vote from peers 852412f37ad44dc5905d2f0c353d7561 (127.14.146.253:41101), 25e0e5bd18b84324882b3d60a33d174c (127.14.146.252:33893)
I20260808 21:05:50.706117 18576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc481b8df6a1479996a6bfb883e90eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "25e0e5bd18b84324882b3d60a33d174c"
I20260808 21:05:50.706246 18576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:50.707223 18576 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc481b8df6a1479996a6bfb883e90eaf in term 1.
I20260808 21:05:50.707453 18277 leader_election.cc:302] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25e0e5bd18b84324882b3d60a33d174c, dc481b8df6a1479996a6bfb883e90eaf; no voters:
I20260808 21:05:50.707592 18652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 21:05:50.707758 18652 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [term 1 LEADER]: Becoming Leader. State: Replica: dc481b8df6a1479996a6bfb883e90eaf, State: Running, Role: LEADER
I20260808 21:05:50.707858 18652 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } }
I20260808 21:05:50.708452 18652 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc481b8df6a1479996a6bfb883e90eaf. Latest consensus state: current_term: 1 leader_uuid: "dc481b8df6a1479996a6bfb883e90eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.708544 18652 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:50.709527 18687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 21:05:50.710047 18687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 21:05:50.709666 18246 master_runner.cc:186] Error getting master registration for 127.14.146.253:41101: OK, instance_id { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" instance_seqno: 1786223150500719 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 21:05:50.712749 18246 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 21:05:50.715230 18576 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [term 1 FOLLOWER]: Refusing update from remote peer dc481b8df6a1479996a6bfb883e90eaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:50.716365 18652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:50.718622 18627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc481b8df6a1479996a6bfb883e90eaf. Latest consensus state: current_term: 1 leader_uuid: "dc481b8df6a1479996a6bfb883e90eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.718720 18627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:50.720155 18494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.707107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57460 (local address 127.14.146.253:41101)
0808 21:05:50.707166 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.707168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.708452 (+ 1284us) server_negotiation.cc:407] Connection header received
0808 21:05:50.708555 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.708556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.708569 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.708603 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.709724 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.710437 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.711304 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.711611 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.711682 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.715649 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.715650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.715651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.715658 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.718296 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.719208 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.719209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.719210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.719267 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.719490 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.719491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.719491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.719628 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.719704 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.719922 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.720008 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 21:05:50.720933 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.708227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48890 (local address 127.14.146.252:33893)
0808 21:05:50.708266 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.708268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.709196 (+ 928us) server_negotiation.cc:407] Connection header received
0808 21:05:50.713245 (+ 4049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.713246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.713257 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.713286 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.713912 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.714588 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.716062 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.716379 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.716424 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.717868 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.717869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.717870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.717877 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.719612 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.720009 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.720010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.720011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.720082 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.720305 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.720306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.720306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.720438 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.720519 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.720755 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.720832 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 21:05:50.721436 18627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc481b8df6a1479996a6bfb883e90eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.721539 18627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:50.721871 18693 mvcc.cc:205] Tried to move back new op lower bound from 7316370025323888640 to 7316370025300443136. Current Snapshot: MvccSnapshot[applied={T|T < 7316370025323888640}]
I20260808 21:05:50.722707 18687 catalog_manager.cc:1347] Generated new cluster ID: 78d5e1ab22d14aee9f13853af6e327ba
I20260808 21:05:50.722752 18687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 21:05:50.728247 18674 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc481b8df6a1479996a6bfb883e90eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.728359 18674 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:50.728487 18695 mvcc.cc:205] Tried to move back new op lower bound from 7316370025323888640 to 7316370025300443136. Current Snapshot: MvccSnapshot[applied={T|T < 7316370025323888640 or (T in {7316370025323888640})}]
I20260808 21:05:50.737051 18488 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } attempt: 3
Aug 08 21:05:50 dist-test-slave-t3q3 krb5kdc[18225](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786223150, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.146.253@KRBTEST.COM for kudu/127.14.146.252@KRBTEST.COM
I20260808 21:05:50.742379 18362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.707674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48290 (local address 127.14.146.254:43525)
0808 21:05:50.707715 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.707717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.708780 (+ 1063us) server_negotiation.cc:407] Connection header received
0808 21:05:50.708876 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.708877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.708887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.708918 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.711565 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.712281 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.713397 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.713718 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.713762 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.715173 (+ 1411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.715175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.715175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.715182 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.717148 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.722165 (+ 5017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.722166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.722166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.722249 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.722654 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.722655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.722655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.722792 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.722880 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.742187 (+ 19307us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.742277 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 21:05:50.746047 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.737274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.146.252:33893 (local address 127.0.0.1:48904)
0808 21:05:50.737348 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 21:05:50.737358 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 21:05:50.737391 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 21:05:50.737607 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 21:05:50.737608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 21:05:50.737770 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 21:05:50.737810 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.737811 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.738663 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.738664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.739428 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 21:05:50.739429 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.739932 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.739933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 21:05:50.739983 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.740614 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 21:05:50.740629 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 21:05:50.742933 (+ 2304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 21:05:50.744959 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.744960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.744960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.745184 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.745412 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 21:05:50.745413 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 21:05:50.745413 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 21:05:50.745480 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 21:05:50.745762 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 21:05:50.745763 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 21:05:50.745817 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 21:05:50.745873 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 21:05:50.745957 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 21:05:50.746558 18623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:50.737451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48904 (local address 127.14.146.252:33893)
0808 21:05:50.737497 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.737499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.737505 (+ 6us) server_negotiation.cc:407] Connection header received
0808 21:05:50.737524 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.737525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.737533 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.737573 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.737875 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.738574 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.739551 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:50.739836 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:50.739887 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:50.743027 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 21:05:50.743029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 21:05:50.743029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 21:05:50.743036 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 21:05:50.744855 (+ 1819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.745270 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.745271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.745271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.745337 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 21:05:50.745547 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 21:05:50.745547 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 21:05:50.745548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 21:05:50.745678 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 21:05:50.745725 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:50.746408 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 21:05:50.746477 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 21:05:50.748108 18488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561: Bootstrap starting.
I20260808 21:05:50.748796 18488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561: Neither blocks nor log segments found. Creating new log.
I20260808 21:05:50.749053 18488 log.cc:824] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561: Log is configured to *not* fsync() on all Append() calls
I20260808 21:05:50.750187 18488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561: No bootstrap required, opened a new log
I20260808 21:05:50.752307 18488 raft_consensus.cc:348] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } }
I20260808 21:05:50.752426 18488 raft_consensus.cc:729] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 852412f37ad44dc5905d2f0c353d7561, State: Initialized, Role: FOLLOWER
I20260808 21:05:50.752490 18488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } }
I20260808 21:05:50.752775 18488 sys_catalog.cc:564] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 21:05:50.753985 18443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [term 0 FOLLOWER]: Advancing to term 1
I20260808 21:05:50.754791 18443 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [term 1 FOLLOWER]: Refusing update from remote peer dc481b8df6a1479996a6bfb883e90eaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 21:05:50.754961 18446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dc481b8df6a1479996a6bfb883e90eaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "852412f37ad44dc5905d2f0c353d7561"
I20260808 21:05:50.755635 18446 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc481b8df6a1479996a6bfb883e90eaf in term 1.
I20260808 21:05:50.756695 18674 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 21:05:50.760203 18704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc481b8df6a1479996a6bfb883e90eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.760352 18704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:50.760454 18704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc481b8df6a1479996a6bfb883e90eaf. Latest consensus state: current_term: 1 leader_uuid: "dc481b8df6a1479996a6bfb883e90eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.760602 18704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 21:05:50.760694 18704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dc481b8df6a1479996a6bfb883e90eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.760794 18704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 21:05:50.757084 18723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 21:05:50.761899 18723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 21:05:50.762005 18687 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 21:05:50.762727 18687 catalog_manager.cc:1504] Loading token signing keys...
I20260808 21:05:50.763214 18729 mvcc.cc:205] Tried to move back new op lower bound from 7316370025323888640 to 7316370025300443136. Current Snapshot: MvccSnapshot[applied={T|T < 7316370025323888640}]
I20260808 21:05:50.772344 18674 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dc481b8df6a1479996a6bfb883e90eaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc481b8df6a1479996a6bfb883e90eaf" member_type: VOTER last_known_addr { host: "127.14.146.254" port: 43525 } } peers { permanent_uuid: "852412f37ad44dc5905d2f0c353d7561" member_type: VOTER last_known_addr { host: "127.14.146.253" port: 41101 } } peers { permanent_uuid: "25e0e5bd18b84324882b3d60a33d174c" member_type: VOTER last_known_addr { host: "127.14.146.252" port: 33893 } } }
I20260808 21:05:50.772460 18674 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf [sys.catalog]: This master's current role is: LEADER
I20260808 21:05:50.778251 18687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc481b8df6a1479996a6bfb883e90eaf: Generated new TSK 0
I20260808 21:05:50.778453 18687 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 21:05:50.805851 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.803987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57468 (local address 127.14.146.253:41101)
0808 21:05:50.804033 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.804036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.805019 (+ 983us) server_negotiation.cc:407] Connection header received
0808 21:05:50.805280 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.805282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.805294 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.805326 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.805780 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57468: BlockingRecv error: recv got EOF from 127.0.0.1:57468 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 21:05:50.806648 18362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.804421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48298 (local address 127.14.146.254:43525)
0808 21:05:50.804460 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.804462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.806127 (+ 1665us) server_negotiation.cc:407] Connection header received
0808 21:05:50.806232 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.806233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.806244 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.806274 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.806586 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48298: BlockingRecv error: recv got EOF from 127.0.0.1:48298 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 21:05:50.807392 18623 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.804750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48912 (local address 127.14.146.252:33893)
0808 21:05:50.804790 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.804792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.806879 (+ 2087us) server_negotiation.cc:407] Connection header received
0808 21:05:50.806982 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.806983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.806994 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.807023 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.807336 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48912: BlockingRecv error: recv got EOF from 127.0.0.1:48912 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 21:05:50.809768 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.808608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.14.146.253:41101)
0808 21:05:50.808649 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.808650 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.809240 (+ 590us) server_negotiation.cc:407] Connection header received
0808 21:05:50.809348 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.809349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.809370 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.809399 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.809723 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57482: BlockingRecv error: recv got EOF from 127.0.0.1:57482 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 21:05:50.812769 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.811938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57484 (local address 127.14.146.253:41101)
0808 21:05:50.811969 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.811971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.812299 (+ 328us) server_negotiation.cc:407] Connection header received
0808 21:05:50.812392 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.812393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.812403 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.812432 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.812727 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57484: BlockingRecv error: recv got EOF from 127.0.0.1:57484 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 21:05:50.816576 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.815796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57498 (local address 127.14.146.253:41101)
0808 21:05:50.815829 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.815831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.816054 (+ 223us) server_negotiation.cc:407] Connection header received
0808 21:05:50.816194 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.816195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.816205 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.816234 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.816532 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57498: BlockingRecv error: recv got EOF from 127.0.0.1:57498 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 21:05:50.822378 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.821610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.14.146.253:41101)
0808 21:05:50.821644 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.821646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.821881 (+ 235us) server_negotiation.cc:407] Connection header received
0808 21:05:50.821976 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.821977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.821986 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.822015 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.822334 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57500: BlockingRecv error: recv got EOF from 127.0.0.1:57500 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 21:05:50.832261 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.831437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57504 (local address 127.14.146.253:41101)
0808 21:05:50.831471 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.831473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.831709 (+ 236us) server_negotiation.cc:407] Connection header received
0808 21:05:50.831806 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.831807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.831817 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.831845 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.832199 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57504: BlockingRecv error: recv got EOF from 127.0.0.1:57504 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 21:05:50.850426 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.849478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57510 (local address 127.14.146.253:41101)
0808 21:05:50.849520 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.849522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.849813 (+ 291us) server_negotiation.cc:407] Connection header received
0808 21:05:50.849918 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.849919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.849931 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.849961 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.850372 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57510: BlockingRecv error: recv got EOF from 127.0.0.1:57510 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 21:05:50.884871 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.883821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57514 (local address 127.14.146.253:41101)
0808 21:05:50.883866 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.883868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.884231 (+ 363us) server_negotiation.cc:407] Connection header received
0808 21:05:50.884347 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.884349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.884362 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.884395 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.884808 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57514: BlockingRecv error: recv got EOF from 127.0.0.1:57514 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 21:05:50.951117 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:50.950334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57530 (local address 127.14.146.253:41101)
0808 21:05:50.950437 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:50.950439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:50.950554 (+ 115us) server_negotiation.cc:407] Connection header received
0808 21:05:50.950591 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:50.950592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:50.950605 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:50.950675 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:50.951067 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57530: BlockingRecv error: recv got EOF from 127.0.0.1:57530 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 21:05:51.081214 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:51.080568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57542 (local address 127.14.146.253:41101)
0808 21:05:51.080648 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:51.080649 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:51.080696 (+ 47us) server_negotiation.cc:407] Connection header received
0808 21:05:51.080768 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:51.080769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:51.080780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:51.080833 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:51.081157 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57542: BlockingRecv error: recv got EOF from 127.0.0.1:57542 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 21:05:51.339152 18494 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 21:05:51.338479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57558 (local address 127.14.146.253:41101)
0808 21:05:51.338570 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:51.338572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:51.338582 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:51.338610 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:51.338611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:51.338621 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:51.338684 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 21:05:51.339067 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57558: BlockingRecv error: recv got EOF from 127.0.0.1:57558 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 21:05:51.696369 18645 catalog_manager.cc:1259] Loaded cluster ID: 78d5e1ab22d14aee9f13853af6e327ba
I20260808 21:05:51.696439 18645 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c: loading cluster ID for follower catalog manager: success
I20260808 21:05:51.697217 18645 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c: acquiring CA information for follower catalog manager: success
I20260808 21:05:51.697469 18645 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 25e0e5bd18b84324882b3d60a33d174c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:05:51.762439 18723 catalog_manager.cc:1259] Loaded cluster ID: 78d5e1ab22d14aee9f13853af6e327ba
I20260808 21:05:51.762573 18723 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561: loading cluster ID for follower catalog manager: success
I20260808 21:05:51.763403 18723 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561: acquiring CA information for follower catalog manager: success
I20260808 21:05:51.763731 18723 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 852412f37ad44dc5905d2f0c353d7561: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 21:05:51.855104 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:51.852331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57562 (local address 127.14.146.253:41101)
0808 21:05:51.852471 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:51.852473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:51.852483 (+ 10us) server_negotiation.cc:407] Connection header received
0808 21:05:51.852545 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:51.852546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:51.852596 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:51.852670 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:51.852811 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.853401 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.854298 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.854523 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.854581 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:51.854736 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:51.854868 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:51.854931 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:51.854968 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 21:05:51.854987 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
I20260808 21:05:51.859251 18857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:51.857063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48924 (local address 127.14.146.252:33893)
0808 21:05:51.857190 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:51.857192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:51.857221 (+ 29us) server_negotiation.cc:407] Connection header received
0808 21:05:51.857255 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:51.857255 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:51.857291 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:51.857351 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:51.857457 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.857925 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.858592 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.858783 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.858834 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:51.858968 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:51.859064 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:51.859119 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:51.859170 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 21:05:51.859192 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":73,"threads_started":1}
I20260808 21:05:51.863919 18857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:51.860942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48938 (local address 127.14.146.252:33893)
0808 21:05:51.860984 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:51.860986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:51.861198 (+ 212us) server_negotiation.cc:407] Connection header received
0808 21:05:51.861282 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:51.861283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:51.861294 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:51.861337 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:51.861479 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.862195 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.863160 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.863449 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.863511 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:51.863675 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:51.863706 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:51.863753 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:51.863811 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 21:05:51.863829 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 21:05:51.863963 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:51.860860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57576 (local address 127.14.146.253:41101)
0808 21:05:51.860899 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:51.860902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:51.861098 (+ 196us) server_negotiation.cc:407] Connection header received
0808 21:05:51.861204 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:51.861206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:51.861217 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:51.861273 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:51.861612 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.862072 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.863198 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.863398 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.863481 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:51.863684 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:51.863715 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:51.863743 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:51.863861 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 21:05:51.863886 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 21:05:51.864389 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 21:05:51.860957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48310 (local address 127.14.146.254:43525)
0808 21:05:51.861067 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 21:05:51.861069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 21:05:51.861078 (+ 9us) server_negotiation.cc:407] Connection header received
0808 21:05:51.861146 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 21:05:51.861147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 21:05:51.861195 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 21:05:51.861277 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 21:05:51.861507 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.862259 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.863041 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 21:05:51.863375 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 21:05:51.863444 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 21:05:51.863658 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 21:05:51.863764 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 21:05:51.863824 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 21:05:51.864272 (+ 448us) server_negotiation.cc:299] Negotiation successful
0808 21:05:51.864294 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":58,"threads_started":1}
I20260808 21:05:51.866070 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 18246
I20260808 21:05:51.880880 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 18371
I20260808 21:05:51.891644 14923 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskW6SX4Q/build/release/bin/kudu with pid 18500
2026-08-08T21:05:51Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3072 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6129 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (281430 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST